-- Logs begin at Mon 2022-08-29 19:25:26 UTC, end at Mon 2022-08-29 20:30:09 UTC. -- Aug 29 19:58:27.485136 dv-cinder-854261-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 19:58:27 2022] *** Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: nodename: dv-cinder-854261-2-smb Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: machine: x86_64 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: clock source: unix Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: pcre jit disabled Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: detected number of CPU cores: 4 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: current working directory: / Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: detected binary path: /usr/bin/uwsgi-core Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: your processes number limit is 47680 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: your memory page size is 4096 bytes Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: detected max file descriptor number: 2048 Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: lock engine: pthread robust mutexes Aug 29 19:58:27.496795 dv-cinder-854261-2-smb devstack@keystone.service[81680]: thunder lock: enabled Aug 29 19:58:27.498977 dv-cinder-854261-2-smb devstack@keystone.service[81680]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 19:58:27.498977 dv-cinder-854261-2-smb devstack@keystone.service[81680]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 19:58:27.540286 dv-cinder-854261-2-smb devstack@keystone.service[81680]: Python main interpreter initialized at 0x5594319de9c0 Aug 29 19:58:27.540286 dv-cinder-854261-2-smb devstack@keystone.service[81680]: python threads support enabled Aug 29 19:58:27.540286 dv-cinder-854261-2-smb devstack@keystone.service[81680]: your server socket listen backlog is limited to 100 connections Aug 29 19:58:27.540286 dv-cinder-854261-2-smb devstack@keystone.service[81680]: your mercy for graceful operations on workers is 90 seconds Aug 29 19:58:27.541095 dv-cinder-854261-2-smb devstack@keystone.service[81680]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 19:58:27.541095 dv-cinder-854261-2-smb devstack@keystone.service[81680]: *** Operational MODE: preforking *** Aug 29 19:58:27.541095 dv-cinder-854261-2-smb devstack@keystone.service[81680]: *** uWSGI is running in multiple interpreter mode *** Aug 29 19:58:27.541095 dv-cinder-854261-2-smb devstack@keystone.service[81680]: spawned uWSGI master process (pid: 81680) Aug 29 19:58:27.541374 dv-cinder-854261-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 19:58:27.544789 dv-cinder-854261-2-smb devstack@keystone.service[81680]: spawned uWSGI worker 1 (pid: 81694, cores: 1) Aug 29 19:58:27.544789 dv-cinder-854261-2-smb devstack@keystone.service[81680]: spawned uWSGI worker 2 (pid: 81695, cores: 1) Aug 29 19:58:27.544789 dv-cinder-854261-2-smb devstack@keystone.service[81680]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 19:58:32.055680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:58:32.055680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Aug 29 19:58:32.056464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:58:32.056464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Aug 29 19:58:32.059158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:58:32.059158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: from cryptography.utils import int_from_bytes Aug 29 19:58:32.059986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:58:32.059986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: from cryptography.utils import int_from_bytes Aug 29 19:58:32.107433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:58:32.107652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:58:32.107827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] command line args: [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:58:32.108102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:58:32.108235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ================================================================================ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:58:32.108507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.108771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_dir = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.108974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.109113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_source = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.109314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] debug = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.109517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.109866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.110048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.110345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.110594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.110826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.110976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_config_append = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.111054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:58:32.111127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.111241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:58:32.111325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_dir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.111423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] command line args: [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:58:32.111500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.111720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.111843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:58:32.111843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ================================================================================ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:58:32.111970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] admin_token = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_dir = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.112853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_source = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] debug = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.113951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.114979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_config_append = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_dir = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] publish_errors = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.115971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.116881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] standard_threads = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.117904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_journal = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_json = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_stderr = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_syslog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.118974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.119130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.119394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.119543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.119646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.119793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] publish_errors = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.119869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.119976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.120096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.120217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.120311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.120385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.120594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.120728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.120954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.121041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.121125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.121199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] standard_threads = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.121300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.121391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.121578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.121710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.121801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.121888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.121961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_journal = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.122031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.122100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_json = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.122271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.122407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_stderr = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.122488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_syslog = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.122565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.122637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:58:32.122758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.122930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.123985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.124894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.125867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.126909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127382 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.127925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.128966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.129944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.130900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.131997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.132880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.133996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.134780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.135999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.136885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.137969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.138928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.139935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.140914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.141949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.142881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.143798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.144920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.external = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.145929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.password = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.token = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.146936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.147994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.148921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.149932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.150926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.external = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.151897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.password = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.152991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.token = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.153974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.154876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.155984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.156815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.157999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.158822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.159479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.159615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.159744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.159880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.160905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.161987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.162967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.163808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.164969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.165948 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.166966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.167957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.168873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.169879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.170870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.171996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.172969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.173979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.174969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.175932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.176810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.177870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.178894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.179891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180544 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.180905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.181900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.182995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.183988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.184936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.185993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.186859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.187909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.188956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.189853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.190933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.191982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.192915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.193674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.194874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.195842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.196989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.197976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.198064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.198213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.198295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.198368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:58:32.198440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.198859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.199103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.199345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.199600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.199840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.200100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.200353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.200594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.200866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.201121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.201372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.201613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.201855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.202093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.202443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.202820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.203057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.203308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.203582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.203850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.204100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.204354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.204596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.204870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.205116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.205358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.205665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.206189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.206663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.206930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.207184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.207427 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.207684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.207925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.208176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.208531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.208945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.209309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:58:32.209459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:58:32.230184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.230451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.230626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.236946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.237415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.237554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.240482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.247451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.270047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.270378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.276845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.277089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.327121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.328297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.380552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.380846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.383837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.384052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.545659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.545875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.546059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.546306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.546526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.546736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.561066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.561350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.561470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.561712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.561910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.562157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.572331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.572569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.572807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.573028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.573239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.573449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.573659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.576681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.576950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.577220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.577400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.577619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.577837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.578049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.586417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.586968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.601974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.602867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 19:58:32.621698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.621927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.621927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 19:58:32.622189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 19:58:32.622312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.622432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.622551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 19:58:32.622677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 19:58:32.622807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.622919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.623956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.634979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.635269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.635475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.635584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.635775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.635889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.636032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.636323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.643290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.643762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.646829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.647062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.647213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.647380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.647505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.647631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.647771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.647895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.648923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.649892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.672571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.674107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.674389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.675438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.677033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.677311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.679190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.679482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.679771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.682442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.682761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.683069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.686776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.687067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.690380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.690799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.691549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.691851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.692142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.692666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.693071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.695412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.695720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.696696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.697048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.697323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.697649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.713053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.713400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.716583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.716911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.717714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.721155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.721516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.724356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.726156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.730023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.731096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.731629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.737376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.737376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.737376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.738545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.738681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.739262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.742086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.751854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.760855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.761578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.762001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.763443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.763443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.763443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.763777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.763931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.764280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.764716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.771083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.772900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.774473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.774750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.777933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.778514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.778514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.780142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.780142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.786459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.787786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.787786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.787786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.794856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.796428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.798026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.798307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.800902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.801415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.801992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.802261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.802349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.802743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.802937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.803242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.803326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.803566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.803759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.804258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.815934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.816457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.816930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.817231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.817523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.817824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.818123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.823100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.826351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.829491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.831074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.832560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.832882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.833192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.835441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.838645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.840469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.841825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.842061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.843307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.845322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.845886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.853153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.854165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.854474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.854764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.854854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.858111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.858413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.858711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.858996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.861838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.862189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.862481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.862767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.863099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.863496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.863847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.864149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.864489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.864796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.865070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.865334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.865602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.865882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.867901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.868213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.868504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.875980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 19:58:32.876276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.876902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.877160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.877461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.878006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.878485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.878910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.879230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.879509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.879773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.880042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.880312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.880608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 19:58:32.902661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594319de9c0 pid: 81695 (default app) Aug 29 19:58:32.906411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e0be-b253-44d2-90c2-590159529e07 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:32.906691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e0be-b253-44d2-90c2-590159529e07 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:32.906968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e0be-b253-44d2-90c2-590159529e07 None None] PATH_INFO: `/v3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:32.911761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Mon Aug 29 19:58:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:32.919571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594319de9c0 pid: 81694 (default app) Aug 29 19:58:39.805824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:39.806733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:39.806733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:39.808451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:58:39.818047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:39.819034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:39.819034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:39.896715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: INFO dbcounter [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] Registered counter for database keystone Aug 29 19:58:39.916267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG oslo_db.sqlalchemy.engines [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:58:39.923313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writer thread running {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:58:40.117832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG passlib.handlers.bcrypt [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81694) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 19:58:40.118180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG passlib.handlers.bcrypt [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81694) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 19:58:40.178276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:40.179881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:40.322218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1/3] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 19:58:40.814307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:40.889546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: INFO dbcounter [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] Registered counter for database keystone Aug 29 19:58:40.912034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:58:40.919796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writer thread running {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:58:41.040300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2332f73-50b4-4530-8d5c-8922fefe2f12 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:41.044693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:41.045368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:41.045641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:41.045914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:41.054740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:41.105681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING keystone.common.rbac_enforcer.enforcer [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 19:58:41.106019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021328e1-8461-41d5-839f-158ac6a57c1d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:41.116668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1324 bytes} [Mon Aug 29 19:58:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:58:41.123647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:41.139561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6be881-36c8-48ea-b011-9ff944b320a0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:41.144709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:41.145888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:41.146162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:41.146428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] PATH_INFO: `/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:41.147906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] RBAC: Authorizing `identity:get_project(project_id=f12e64257ff84ab8bb7ebdf7133980d9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:41.200490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 19:58:41.200851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee8705-8869-4b50-85b6-66c499568d1b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:41.205801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 2/5] 10.222.0.61 () {56 vars in 1207 bytes} [Mon Aug 29 19:58:41 2022] GET /identity/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:43.105613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01841-c5aa-4006-9ac9-72db0067bbc9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:43.106180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01841-c5aa-4006-9ac9-72db0067bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:43.106180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c01841-c5aa-4006-9ac9-72db0067bbc9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:43.110229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 4/6] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:43.117150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:43.117609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:43.117713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:43.138557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:43.140071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:43.148877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 19:58:43.418963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01841-c5aa-4006-9ac9-72db0067bbc9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:43.436788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c01841-c5aa-4006-9ac9-72db0067bbc9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:43.442191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:43.442822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:43.443097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:43.443368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:43.451821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:43.453616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf12dac-088b-4efe-a683-cdf791596009 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:43.462455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1324 bytes} [Mon Aug 29 19:58:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:58:43.468428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:43.477952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2caa-6767-48de-bc82-69ee55d3ab39 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:43.482840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:43.483474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:43.483755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:43.484019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:43.485411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:43.487339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ae0c9-89cf-4b62-a660-47f5017cb15c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:43.488913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 4/9] 10.222.0.61 () {56 vars in 1198 bytes} [Mon Aug 29 19:58:43 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:45.530764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb3d6-bf9a-4d4a-b0c6-c707f740d168 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:45.531361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb3d6-bf9a-4d4a-b0c6-c707f740d168 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:45.531447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5941f8-22d5-4394-9637-3e23b6d70afa None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:45.531779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb3d6-bf9a-4d4a-b0c6-c707f740d168 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:45.531854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5941f8-22d5-4394-9637-3e23b6d70afa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:45.531854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5941f8-22d5-4394-9637-3e23b6d70afa None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:45.532627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:45.533139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 5/11] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:58:45.538815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:45.539157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:45.539279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:45.539494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:45.539612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:45.539891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:45.561552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:45.562768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:45.585278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81695) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 19:58:45.585664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81695) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 19:58:45.634738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:45.645261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:45.657239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:45.773662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:45.925658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:45.958925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.038468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.074625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7a82-8b2c-4087-85cf-326dbe361ca8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.115755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.116419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.116692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.117025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.130519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:58:46.139783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:58:46.140735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:58:46.141629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:58:46.148392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.149696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67e724-18c2-457c-9676-c2b162973b38 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.152285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.196139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.197027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.197297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.197627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.247912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.268373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a049ae-2794-41cf-9b60-81ba9525adbd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.276820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.278372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.308505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.309224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.309559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.309904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.310694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:46.311068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.312624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.326322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:46.332118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.385492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:58:46.391283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.394553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.465164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe864d-33cc-4ac9-aaf3-317b6fa26d00 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.503228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d025bb-bb0b-4107-85a0-9134c1953884 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.512133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.512840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.513120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.513392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.514578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.516047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.518077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:46.523931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.540083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.541216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.542001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.542308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.542643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.561847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.563325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:58:46.582655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:58:46.583720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:58:46.584701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:58:46.584701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:58:46.584701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:58:46.584701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:58:46.589943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.632380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ebf6-c215-4d68-b6cc-cbd37b61c264 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.652079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.676322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.677893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.677893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.677893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.679638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.682624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.682624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:46.688913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:46.710000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71b61a-4aeb-4505-ab65-60bc61fa3896 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.748635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.749181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.749452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.749720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.750370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:46.750671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.752471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f917f8-fef6-441e-bb3a-3da71c74ce29 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.771668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 10/20] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:46.815767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:46.844226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f0f5b-5fc6-4671-b3fd-c82fe9af9e56 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:46.892461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:46.893451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:46.893733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:46.894039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:46.894868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.domain.id=default, user.id=8a682bb868194e74ab874d8a9a46c89e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:46.895184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:46.896739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7f28c-30c4-4c05-a121-f223c3fee1cd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:46.906823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 11/21] 10.222.0.61 () {56 vars in 1322 bytes} [Mon Aug 29 19:58:46 2022] GET /identity/v3/role_assignments?user.id=8a682bb868194e74ab874d8a9a46c89e&scope.domain.id=default&role.id=911a5bcd4e504f538aeb3869289f542b => generated 233 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:49.225224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbb8d-2be5-4665-9c48-2debcb6d5e38 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.225893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbb8d-2be5-4665-9c48-2debcb6d5e38 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.225893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bbb8d-2be5-4665-9c48-2debcb6d5e38 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.227338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 11/22] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:49.243488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8b86-3bda-4354-a58e-404d0a41cf1c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.244236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8b86-3bda-4354-a58e-404d0a41cf1c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.244236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8b86-3bda-4354-a58e-404d0a41cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.283775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-163f8b86-3bda-4354-a58e-404d0a41cf1c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:49.285940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-163f8b86-3bda-4354-a58e-404d0a41cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:49.353200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf36d-422b-4184-a4c6-d9884be8366f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.353576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf36d-422b-4184-a4c6-d9884be8366f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.353799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf36d-422b-4184-a4c6-d9884be8366f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.355421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 12/23] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:49.367796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb70ac-54ec-4417-9704-cbbd4bc14a5f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.368174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb70ac-54ec-4417-9704-cbbd4bc14a5f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.368930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb70ac-54ec-4417-9704-cbbd4bc14a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.420128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5efb70ac-54ec-4417-9704-cbbd4bc14a5f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:49.429563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5efb70ac-54ec-4417-9704-cbbd4bc14a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:49.430592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:58:49.568406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:58:49.655085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db220e1-0746-4d29-8044-7458d051e153 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.655466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db220e1-0746-4d29-8044-7458d051e153 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.655665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db220e1-0746-4d29-8044-7458d051e153 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.664001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 13/26] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:49.664208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:49.664208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:49.664444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:49.696635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:49.698580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:49.771149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:49.807061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 14/27] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:49.914225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db220e1-0746-4d29-8044-7458d051e153 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.029130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:50.042273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.062489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db220e1-0746-4d29-8044-7458d051e153 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.130420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.131444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.131911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.132387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.161813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:58:50.167185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:58:50.168027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:50.168813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:58:50.171140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 14/28] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:58:50.178414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.247728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1ea23-7ee2-4405-b924-2bc3a8c6a0f8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.298572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.299968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.300259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.300532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.316338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.318118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:58:50.334889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:58:50.335832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:58:50.336672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:58:50.336672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:58:50.336672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:58:50.338639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 15/29] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:58:50.339668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.368283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a40d0-0058-436f-9c23-0bb8da1174ba None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.378554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:50.407344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.408319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.408800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.409293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.410195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:50.410645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.412344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.414292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:50.423281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 15/30] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:50.429275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.468410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21bf17-4a3c-4d50-abb7-d741cbe4c5d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.506636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.507710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.508188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.508654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.509651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.511352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c038d97-f82d-4c65-acc6-3f1a00db65e5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.551396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c3156-1d26-41bb-9eef-f6000f72aecc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.600579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.601236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.601505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.601780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.602394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:50.602701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.604105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87576249-9afb-487a-8abc-25fab87e83fe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 16/31] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 19:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477e3-ebef-414a-909f-886cbfb48b63 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477e3-ebef-414a-909f-886cbfb48b63 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded477e3-ebef-414a-909f-886cbfb48b63 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 17/32] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:50.631967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded477e3-ebef-414a-909f-886cbfb48b63 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.638088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 16/33] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Aug 29 19:58:50 2022] POST /identity/v3/roles => generated 219 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:58:50.639575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741f54-0c9f-43b5-82ac-7cd1a6af92af None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.639864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741f54-0c9f-43b5-82ac-7cd1a6af92af None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.640131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741f54-0c9f-43b5-82ac-7cd1a6af92af None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.641587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 17/34] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:50.642248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741f54-0c9f-43b5-82ac-7cd1a6af92af None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:50.750852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:50.792111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:50.812277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741f54-0c9f-43b5-82ac-7cd1a6af92af None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.822249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded477e3-ebef-414a-909f-886cbfb48b63 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:50.865981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.866760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.867041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.868578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.869467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:50.869899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb9e7b-4570-4ab7-add7-18afae3d8f0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.870529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.871004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.871456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.873718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:50.875368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2916-4e2d-4995-8ee2-91845927e544 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:50.878059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 18/35] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:58:50 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:50.878919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.879968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.879968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.900557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:50.902201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:50.908858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 18/36] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 19:58:50 2022] POST /identity/v3/projects => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:58:50.908858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80fb4-4844-4549-9b42-0903273254cc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:50.908858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80fb4-4844-4549-9b42-0903273254cc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:50.908858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e80fb4-4844-4549-9b42-0903273254cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:50.927281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19e80fb4-4844-4549-9b42-0903273254cc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:50.929210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19e80fb4-4844-4549-9b42-0903273254cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:51.023652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 19/37] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:51.025867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.031782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 19/38] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:51.109629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:51.166356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd07af-b475-4bb9-aaf6-2a5cb123a432 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.186145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a89cb-bde2-420a-8a68-bae747205a6f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.187078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a89cb-bde2-420a-8a68-bae747205a6f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.187363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a89cb-bde2-420a-8a68-bae747205a6f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.189053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 20/39] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:51.195128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.195407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.195688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.212857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.213517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.213796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.214065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.215628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.217148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:51.217560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:51.218772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:51.218886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 20/40] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:51.226159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.308550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:51.316202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 21/41] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:51.345729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.357848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae55d13-c302-4b8d-8044-305c7ea5cec2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.390205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:51.405274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55322564-679f-4f77-890e-936171174a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.406312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322564-679f-4f77-890e-936171174a81 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.406852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322564-679f-4f77-890e-936171174a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.407449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322564-679f-4f77-890e-936171174a81 None admin] PATH_INFO: `/v3/domains/default/users/8a682bb868194e74ab874d8a9a46c89e/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.409904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55322564-679f-4f77-890e-936171174a81 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8a682bb868194e74ab874d8a9a46c89e, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.411371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55322564-679f-4f77-890e-936171174a81 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:51.468730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db298f3-2ddd-4515-bcef-20e92e002589 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.505443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.506101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.506394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.506631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.507341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.508720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:51.524251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Aug 29 19:58:51 2022] POST /identity/v3/roles => generated 225 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:58:51.526216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.537691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 21/43] 10.222.0.61 () {58 vars in 1361 bytes} [Mon Aug 29 19:58:51 2022] PUT /identity/v3/domains/default/users/8a682bb868194e74ab874d8a9a46c89e/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:58:51.597609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55322564-679f-4f77-890e-936171174a81 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.611441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:51.675838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86460a-7ab1-49db-bcb4-48a005fb4438 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.721578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.722653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.723120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.723444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.725438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.727023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:51.748401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Aug 29 19:58:51 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:58:51.759241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55322564-679f-4f77-890e-936171174a81 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.808409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.809112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.809763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.810002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.811528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.813568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c71f5-d748-49e2-bdcc-3e09ba9d1eff None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:51.818438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 22/45] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:51.824683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:51.950924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897017-c841-47ae-a735-a11ff8ecfac8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:51.973733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:51.990287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:51.990918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:51.991198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:51.991472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:51.992135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:51.993627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc921ab-355d-4856-a135-0227575f1d79 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:52.023077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 19:58:51 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:58:53.566852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef654-d6d3-4894-9412-fd705764ce76 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:53.567606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef654-d6d3-4894-9412-fd705764ce76 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:53.567910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef654-d6d3-4894-9412-fd705764ce76 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:53.570510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 23/47] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:53.578142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159627df-85bf-4b05-8afe-a3244089edec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:53.578763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159627df-85bf-4b05-8afe-a3244089edec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:53.578763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159627df-85bf-4b05-8afe-a3244089edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:53.603783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-159627df-85bf-4b05-8afe-a3244089edec None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:53.605294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-159627df-85bf-4b05-8afe-a3244089edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:53.682706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 25/48] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:58:53.952181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef654-d6d3-4894-9412-fd705764ce76 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:53.983347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041ee4-cc43-4385-b64a-0d73fbffc086 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:53.983620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041ee4-cc43-4385-b64a-0d73fbffc086 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:53.983897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041ee4-cc43-4385-b64a-0d73fbffc086 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:53.985756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 26/49] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:58:53.991401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:53.991679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:53.991947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.013628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:54.014300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:54.104501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 27/50] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:54.133582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:54.194501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef654-d6d3-4894-9412-fd705764ce76 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.232417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.233006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.233350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.233621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.247439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:58:54.252859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:58:54.253804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:58:54.254556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 24/51] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:58:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:58:54.260704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.294420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:54.369419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af21a9-7fd8-47b0-8d74-e33935e048c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.377222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.502431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a66c-edf7-446a-beb4-10a68a9ff74b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.515294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:54.517928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.518582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.518861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.519194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.519818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:54.520118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:54.521582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:54.536099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 28/52] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:54.541948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.545704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.546364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.546641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.546910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.548060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:54.549835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:54.551455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 25/53] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:54.557221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.657017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:54.665683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946167-3542-46ad-9175-581e6ff93438 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.679441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfb0f-d7d0-45fa-89fd-9b3f5e868714 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.714230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.714896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.715113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.715413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.716860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:54.718502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:54.718866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.719490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.719787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.720051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.720433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 29/54] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:58:54 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:54.721010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:54.722609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:54.726526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.759387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 26/55] 10.222.0.61 () {60 vars in 1140 bytes} [Mon Aug 29 19:58:54 2022] POST /identity/v3/projects => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:58:54.872499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e08b7-a131-46f2-9060-62da7e3a9695 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:54.920775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:54.921430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:54.921709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:54.921978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:54.923128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:54.925111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365fbc-9cc8-4642-8fe5-772cf89b2dd2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:54.926849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 30/56] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:58:54.933329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:54.974644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:55.069227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfc5a8-963e-4304-96d8-2136bfaf8621 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:55.115148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:55.115820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:55.116232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:55.116532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:55.117350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.domain.id=default, user.id=8a682bb868194e74ab874d8a9a46c89e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:58:55.117700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:55.119396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625ff3-181b-4ba9-9217-874abcfe96d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:55.127520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 27/57] 10.222.0.61 () {56 vars in 1322 bytes} [Mon Aug 29 19:58:54 2022] GET /identity/v3/role_assignments?user.id=8a682bb868194e74ab874d8a9a46c89e&scope.domain.id=default&role.id=911a5bcd4e504f538aeb3869289f542b => generated 530 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:56.801242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e40e2-d249-4411-ae0c-a989aa2df2e7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:56.801807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e40e2-d249-4411-ae0c-a989aa2df2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:56.801807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e40e2-d249-4411-ae0c-a989aa2df2e7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:56.803267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 31/58] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:58:56.808686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:56.809163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:56.809354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:56.833162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:58:56.834740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:58:56.917983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:58:57.219498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e40e2-d249-4411-ae0c-a989aa2df2e7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:57.257823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:57.338377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e40e2-d249-4411-ae0c-a989aa2df2e7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:57.381139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:57.381788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:57.382068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:57.382338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:57.383484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:57.384975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093101-f7df-4b22-9714-ad4f3d664668 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:57.386684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 32/60] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:58:57.392793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:58:57.419913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:58:57.512347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407b7d-9642-48c7-80b4-5885e22f48fd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:58:57.552239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:58:57.552891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:58:57.553175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:58:57.553453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:58:57.554148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:58:57.555811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190a20-3638-4307-8a7e-516908c4558e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:58:57.587055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 29/61] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:58:57 2022] POST /identity/v3/users => generated 275 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:01.150825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af1f5-908e-482d-94a0-ed5dec61a39e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.151370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af1f5-908e-482d-94a0-ed5dec61a39e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.151370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945af1f5-908e-482d-94a0-ed5dec61a39e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.152931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 33/62] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:01.159513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f15d5-52fb-4ec3-a6a6-a123417751e4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.160110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f15d5-52fb-4ec3-a6a6-a123417751e4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.160704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f15d5-52fb-4ec3-a6a6-a123417751e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.197311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3e9f15d5-52fb-4ec3-a6a6-a123417751e4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:01.199293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3e9f15d5-52fb-4ec3-a6a6-a123417751e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:01.338951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 30/63] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:01.349230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbbd0c-48d9-45d8-9ff1-f8e30c81c55f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.349832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbbd0c-48d9-45d8-9ff1-f8e30c81c55f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.350323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbbd0c-48d9-45d8-9ff1-f8e30c81c55f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.352930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 34/64] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:01.357811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0b0-7432-4f5e-816e-9ea7ca675570 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.358234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0b0-7432-4f5e-816e-9ea7ca675570 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.358640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0b0-7432-4f5e-816e-9ea7ca675570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.398190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0138f0b0-7432-4f5e-816e-9ea7ca675570 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:01.399880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0138f0b0-7432-4f5e-816e-9ea7ca675570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:01.404193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:01.534805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 31/65] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:01.547086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03edb3-1ea2-43df-9c92-b101b70cf07a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.547710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03edb3-1ea2-43df-9c92-b101b70cf07a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.548177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03edb3-1ea2-43df-9c92-b101b70cf07a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.550233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 35/66] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:01.557488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.557901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.558308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.598419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:01.600125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:01.626324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948a9a-b5e3-46ff-a2d5-f4288dd5e774 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.626990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948a9a-b5e3-46ff-a2d5-f4288dd5e774 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.627441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948a9a-b5e3-46ff-a2d5-f4288dd5e774 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.629175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 36/67] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:01.634452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b10dd-42b3-4c47-8000-0bdbd70535ce None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.634989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b10dd-42b3-4c47-8000-0bdbd70535ce None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.635453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b10dd-42b3-4c47-8000-0bdbd70535ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.673286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d04b10dd-42b3-4c47-8000-0bdbd70535ce None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:01.675323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d04b10dd-42b3-4c47-8000-0bdbd70535ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:01.707715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 32/68] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:01.717496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:01.770659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 37/69] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:01.772023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8adbff-b9f6-4700-b471-4dd7f2418b50 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.772460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8adbff-b9f6-4700-b471-4dd7f2418b50 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.772903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8adbff-b9f6-4700-b471-4dd7f2418b50 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.775857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 38/70] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:01.785802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.786328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.786782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.809819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:01.821533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:01.823346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:01.858740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:01.892932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2625a79-bb8d-4c86-bb50-a043ce408f27 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:01.945725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:01.946155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:01.946435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:01.946707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:01.958223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:01.959574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 39/71] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:01.960607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:01.968437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:01.969370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:01.970261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:01.972243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 33/72] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:01.976892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.090275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63cb83-4892-40f1-b356-3cb9f2350035 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.112454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cc762-3972-4847-8ba1-cbb5e407982c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.130059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.131049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.131513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.132065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.154708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.155978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:02.156445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.156871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.157472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.158203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.159404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:02.159888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:02.162249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:02.165005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:02.165896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:02.166668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 40/73] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:02.167308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.178798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 34/74] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:02.179949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.194702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.319650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1b57-5e54-41f7-b1f2-e2f3465de729 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.333559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a24979-4e45-4d3c-99cb-74a72f049224 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.367143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.367795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.368088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.368343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.373293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.373992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.374273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.374657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.382284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:02.387375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:02.388324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:02.389230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 41/75] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:02.389855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:02.390675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:02.394620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:02.395530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:02.396299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 35/76] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:02.396957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.459451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.501140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.531665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29f50a-6289-40ca-9bbc-ea5f6a200a82 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.535613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1b813-249f-4d53-ad9e-b9e2063c2e05 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.580044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.580847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.581265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.581674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.598425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.599466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.599925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.600390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.601527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:02.601627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:02.602085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:02.603861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:02.604050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:02.605932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 36/77] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:02.606885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.627103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 42/78] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:02.627103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.750842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e3344-80c2-4e2c-9efe-68d894334eb0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.761089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485495ac-9d19-4dd8-abf1-58b4b3a2b5f2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.763213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.796930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.797583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.797863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.798128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.799593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:02.801277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:02.802932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 37/79] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:02.803428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:02.803922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.804184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:02.804429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:02.804702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:02.805617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:02.805954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:02.807495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:02.818397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 43/80] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:02.819337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:02.822588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:02.952086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3647c-3f23-4782-b3bd-853f8d71149d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:02.956543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49285b3a-3409-4c01-a242-7db885f473f4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.002502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.003200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.003483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.003762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.004447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:03.004792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.006200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.007325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.008053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.008330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.008599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.015733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 38/81] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:03.017068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.073966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.097837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.100013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.103145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.173392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e0c3-f4e9-4af0-a861-90ce75b9169f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.232392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.233120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.233569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.234017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.235846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.238004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.240800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 39/82] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:03.242049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.246712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 44/83] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:03.246712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.378662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d1c99-043a-409b-b2c9-3c50fc95cca3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.380975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ff52f-eadc-42fb-912a-e89d521b1c11 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.382746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.391760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.419064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.419334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.419819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.419941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.420110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.420201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.420386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.420485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.421094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.421583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.422555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.423013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.424765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 45/84] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:03.425537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.447184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 40/85] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:03 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:03.448260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.605536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ec63-3983-4c7c-aeb8-09fbc772a951 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.639390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e20b-8fec-45e2-9bc7-8595b0be79bd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.678090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.680436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.680712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.681397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.683421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.689469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.700406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 46/86] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:03.700406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:03.703139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.703804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.709914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.709914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.752557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.752942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:03.821105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.823214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.869205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfc312-5732-4472-b2bb-de8f9357b718 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:03.938362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:03.939195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:03.939658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:03.940110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:03.941409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:03.943118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:03.945503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 47/87] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:03.947141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.009115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 41/88] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:04.010881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.134460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:04.147074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10535d4-99d9-4adc-8e21-1e1e23206b40 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:04.162836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:04.208665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbcd1-c3ef-49a1-af3a-12c96308d9b7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:04.215361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:04.216402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:04.216911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:04.217730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:04.275878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:04.277453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:04.278153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:04.278863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:04.347019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:04.349691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:04.419189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:04.421373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:04.520274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:04.544133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 48/89] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:04.551950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.569552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:04.589340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 42/90] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:04.590731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.716069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b24b-5e96-4234-ab7a-54ab01eb5637 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:04.736657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42893d-80a6-49bf-9cbf-3a25ac610fa6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:04.753985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:04.755114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:04.755683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:04.756199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:04.757981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:04.760277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:04.763685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 43/91] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:04 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:04.770271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.801117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:04.802101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:04.802382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:04.802649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:04.803982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:04.804296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:04.805782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:04.817141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 49/92] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:04 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=801153a9ae764c76a1e10058e403d371 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:04.817996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:04.832815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:04.981976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa13ed1-8ddd-455f-8ac1-ee62120bb260 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:05.029151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:05.052239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:05.052978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:05.053275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:05.053555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] PATH_INFO: `/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:05.055903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] RBAC: Authorizing `identity:get_project(project_id=3d594f964dbb475bb9d7adf49c1a24ea)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:05.057437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:05.059203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 44/93] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:04 2022] GET /identity/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:05.060000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:05.074112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c88c-4982-4bd9-894b-6534298f273d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:05.115495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:05.116713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:05.117206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:05.117666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:05.119612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:05.121471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:05.123539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 50/94] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:04 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:05.124656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:05.255644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d421e06-9b62-4e50-aaa4-05a29693b588 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:05.295523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:05.296533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:05.297149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:05.297619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:05.298866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3d594f964dbb475bb9d7adf49c1a24ea, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:05.299405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:05.301530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:05.308789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 51/95] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:05 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3d594f964dbb475bb9d7adf49c1a24ea&role.id=801153a9ae764c76a1e10058e403d371 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:05.310129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:05.320709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:05.380909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:05.393243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b41cb-ba42-4bd5-9c41-e07ca8e3fd6a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:05.511204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff31bc-a691-4da0-9e67-99480c31d64f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:05.534711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:05.536093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:05.536906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:05.537989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:05.539683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:05.540563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:05.543701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b095f-184b-4ed1-9302-167f29887db0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:05.553672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:05.554299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:05.554578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:05.554852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:05.555590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8a682bb868194e74ab874d8a9a46c89e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:05.555896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:05.556502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 45/96] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:05 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=92293530e9464e0ea6885885e170633e => generated 259 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:05.557382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e9d1f-4b60-46dc-bb6c-751b5ebd9758 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:05.567875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 52/97] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:05 2022] GET /identity/v3/role_assignments?user.id=8a682bb868194e74ab874d8a9a46c89e&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:06.283412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477469-6c42-48e4-99f3-9ab47def6772 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:06.283911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477469-6c42-48e4-99f3-9ab47def6772 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:06.284401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477469-6c42-48e4-99f3-9ab47def6772 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:06.287546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 46/98] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:06.294853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bcb-c516-4feb-8666-61bbaf1a1244 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:06.295442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bcb-c516-4feb-8666-61bbaf1a1244 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:06.295927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bcb-c516-4feb-8666-61bbaf1a1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:06.318744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-13291bcb-c516-4feb-8666-61bbaf1a1244 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:06.320305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-13291bcb-c516-4feb-8666-61bbaf1a1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:06.401139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:06.411500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 53/99] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:06.749642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4218b3-7391-475e-9da7-8bb3167ca65e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:06.750464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4218b3-7391-475e-9da7-8bb3167ca65e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:06.750903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4218b3-7391-475e-9da7-8bb3167ca65e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:06.753662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 47/100] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:06.759538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:06.760479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:06.761028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:06.786241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:06.787779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:06.872529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4218b3-7391-475e-9da7-8bb3167ca65e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:06.904532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 54/101] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:07.049889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4218b3-7391-475e-9da7-8bb3167ca65e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:07.106530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:07.107230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:07.107515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:07.107786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:07.109978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:07.112281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:07.114845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 48/102] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:07.126846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:07.359190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee107c-4707-41bd-b879-15cc2e0d4598 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:07.380792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:07.429264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:07.444820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:07.445462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:07.445748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:07.446025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:07.446713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:07.448194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:07.454031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:07.508705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 55/103] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 19:59:07 2022] POST /identity/v3/projects => generated 302 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:07.580120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39729a-0103-441e-88ae-3427494729e7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:07.622966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:07.623638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:07.623926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:07.624229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:07.638984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:07.645869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:07.647497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:07.649455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 49/104] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:07.655643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:07.796937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41270f-5b11-46bb-bc34-b4c2dffd0a7c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:07.840897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:07.841595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:07.841873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:07.842198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:07.842899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:07.843199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:07.844632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:07.855555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 56/105] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:07.862063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:08.019954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:08.030216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60c27-2700-4ce3-b98d-575d4f107e5b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:08.073470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:08.074355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:08.074831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:08.075306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] PATH_INFO: `/v3/users/52ef750fae654354a089c91403af40c7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:08.098737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] RBAC: Authorizing `identity:get_user(user_id=52ef750fae654354a089c91403af40c7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:08.100246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:08.102589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 50/106] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:07 2022] GET /identity/v3/users/52ef750fae654354a089c91403af40c7 => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:08.108844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:08.158345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:08.228197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d65fb0-3c91-4c6e-9e90-0a88453b795d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:08.268435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:08.269168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:08.269453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:08.269753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:08.399909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:08.402635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:08.478648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:08.616836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 57/107] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:08.626983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:08.850496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f6741-aee6-4c43-9c37-44c953af2b4c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:08.907552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:08.908584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:08.908945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:08.909354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:08.910667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:08.912127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2d547-eec3-4218-be6d-eaef4b2d0819 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:08.913972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 51/108] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:08 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:08.922232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:09.081400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daa485-e31a-4e0a-a80e-5ee29c5d3022 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:09.128594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:09.129316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.129603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.129879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.130738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=52ef750fae654354a089c91403af40c7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:09.131046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:09.132504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e5e94-44ce-4cda-8820-79cb16c583c7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:09.140466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 58/109] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:08 2022] GET /identity/v3/role_assignments?user.id=52ef750fae654354a089c91403af40c7&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:09.241871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477989-fdee-4654-8c8e-7b178819af6c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.242471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477989-fdee-4654-8c8e-7b178819af6c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.243058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477989-fdee-4654-8c8e-7b178819af6c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.245780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 52/110] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:09.255613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c5ed-bdd8-4b57-9544-09de9c009900 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.256099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c5ed-bdd8-4b57-9544-09de9c009900 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.256570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69c5ed-bdd8-4b57-9544-09de9c009900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.278959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:09.307410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4a69c5ed-bdd8-4b57-9544-09de9c009900 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:09.309441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4a69c5ed-bdd8-4b57-9544-09de9c009900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:09.439992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 59/111] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:09.612387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976023f1-2520-4fc5-9079-fd9085b11e7e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.612896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976023f1-2520-4fc5-9079-fd9085b11e7e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.613142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976023f1-2520-4fc5-9079-fd9085b11e7e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.614581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 53/112] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:09.622886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606273-002a-464f-9031-0b09707223fa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.623172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606273-002a-464f-9031-0b09707223fa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.623426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87606273-002a-464f-9031-0b09707223fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.650129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-87606273-002a-464f-9031-0b09707223fa None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:09.651680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87606273-002a-464f-9031-0b09707223fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:09.702446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da995f-f012-4fc2-be5f-cb02d8190bdd None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.702745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da995f-f012-4fc2-be5f-cb02d8190bdd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.702926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da995f-f012-4fc2-be5f-cb02d8190bdd None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.704718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 54/113] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:09.717494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673e4b-7394-4a67-a3f6-8dd8c283d2e7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.717803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673e4b-7394-4a67-a3f6-8dd8c283d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.718025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673e4b-7394-4a67-a3f6-8dd8c283d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.757049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d7673e4b-7394-4a67-a3f6-8dd8c283d2e7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:09.758439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d7673e4b-7394-4a67-a3f6-8dd8c283d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:09.767396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 60/114] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:09.788207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:09.848934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606273-002a-464f-9031-0b09707223fa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:09.903933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 55/115] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:09.906286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2dcdd-5110-465d-b57b-f36123abcf7e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.907604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2dcdd-5110-465d-b57b-f36123abcf7e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.908504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2dcdd-5110-465d-b57b-f36123abcf7e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.910561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 56/116] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:09.924465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:09.925197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:09.926096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:09.962229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:09.963473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:10.000233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:10.072352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87606273-002a-464f-9031-0b09707223fa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:10.104868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 57/117] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:10.134188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:10.135018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:10.135487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:10.135769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:10.154993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:10.161956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:10.165200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:10.167447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 61/118] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:10.176790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:10.326603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:10.357014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:10.395600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158617c-35a9-40e9-be1e-e02c11b6ada4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:10.522006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:10.523162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:10.523668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:10.524221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:10.525525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:10.526072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:10.529439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:10.552171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 58/119] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:10.553139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:10.625722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a429b7-1999-4805-95b3-2e6080618d48 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:10.685407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:10.710119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:10.713240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:10.714005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:10.714719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:10.738047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:10.746153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:10.747288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:10.748182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:10.750883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 62/120] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:10.756932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:10.772827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb112219-a34b-4bee-a2b0-493039cad145 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:10.836398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:10.837794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:10.838474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:10.839066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:10.851954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:10.859933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:10.869110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:10.870054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:10.870819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:10.873343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 59/121] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:10.874574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:10.939966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab52bc-86c8-4048-97cc-85c735b2368a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:10.982397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:10.983263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:10.983518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:10.983915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:10.985695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:10.987902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:10.990994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 63/122] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:10.997347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.037237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239cd20-e216-4182-806d-c646da45e7f6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.085288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:11.105748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.106430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.106713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.106988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.120486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:11.129663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:11.130595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:11.131963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 60/123] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:11.138860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.165535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c16208-cd1a-400f-ab5c-7eddbf66800b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.223358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.224334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.224835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.225309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.226464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:11.226974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.229210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.240711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 64/124] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.242283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.249996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:11.317605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c74f06-80ea-4ba4-a68c-3f6f46a4def4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.366747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.368274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.369333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.370895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.373123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:11.374983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.378208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.394759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 61/125] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.396612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.405208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44547f88-6cae-4879-91aa-510112522e74 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.429608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:11.466167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.467176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.468352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.468810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.471249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.474036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.478191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 65/126] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.480282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.541983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000f1b7-b538-45d9-bfea-46d52c61e8a3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.589066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:11.614588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.615624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.616111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.617397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.619069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:11.619623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.623716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.631905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a346057-73e2-44de-98dc-5abf8e22b005 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.644787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 62/127] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.645865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.683995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.685079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.685516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.685823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.687910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.690327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189c10-67fa-42ed-9289-e5fdd3255958 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.692802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 66/128] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.693858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1afa13-3d3b-439b-9861-b31f4d8d9dfc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.694306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1afa13-3d3b-439b-9861-b31f4d8d9dfc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.694591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1afa13-3d3b-439b-9861-b31f4d8d9dfc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.700906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 67/129] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:11.700906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1afa13-3d3b-439b-9861-b31f4d8d9dfc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.771681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:11.801467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0f3e-b978-48e1-a060-cdfae39e1411 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.852535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1afa13-3d3b-439b-9861-b31f4d8d9dfc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:11.864725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.865769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.866218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.866676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.868710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.871366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.874573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 63/130] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:11.875994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.919777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:11.921365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:11.921799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:11.922234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8415463a9ba0463aa60cc65278d679e0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:11.925566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, user_id=8415463a9ba0463aa60cc65278d679e0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:11.927916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:11.950014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 68/131] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:11 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8415463a9ba0463aa60cc65278d679e0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:11.950776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:11.975494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.054374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22787fb9-7881-4ae7-abdb-2fc5446d02d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.105861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.106527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.111391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.111391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.111391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.113038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b85f1e-a524-48d5-b616-d4bc41f387ee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.115960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 64/132] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:12.119044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901ea8-3b33-4950-84d3-183ed386d752 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.119537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901ea8-3b33-4950-84d3-183ed386d752 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.120646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901ea8-3b33-4950-84d3-183ed386d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.127109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8659e4-7d97-4e43-beb5-4ad6639c240d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.147077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.163388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d6901ea8-3b33-4950-84d3-183ed386d752 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:12.165405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d6901ea8-3b33-4950-84d3-183ed386d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:12.189064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.190043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.191040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.191298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.193424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.196319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.199737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 69/133] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:11 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:12.206669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.308185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 65/134] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:12.310643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96469c5-7d15-4aa5-aa3d-1543a9d52c6c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.311148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96469c5-7d15-4aa5-aa3d-1543a9d52c6c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.311632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96469c5-7d15-4aa5-aa3d-1543a9d52c6c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.314333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 66/135] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:12.315984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96469c5-7d15-4aa5-aa3d-1543a9d52c6c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.379207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a550627-672b-442b-a9c1-5d7c8cc4fdc7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.387700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.421770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.423030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.423612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.424079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] PATH_INFO: `/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.425771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] RBAC: Authorizing `identity:get_project(project_id=3d594f964dbb475bb9d7adf49c1a24ea)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.427995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.430344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 70/136] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:12 2022] GET /identity/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:12.436327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.455144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96469c5-7d15-4aa5-aa3d-1543a9d52c6c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.493897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.498429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.499168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.499525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.500432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.501682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.503676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40d90-e1e3-4c82-b845-78dbcd68b472 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.510780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 67/137] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:12 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:12.512500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.512936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.513368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.534804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:12.536191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:12.575307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d0ede-a4c1-437a-98cd-1f848dfdbd6a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.626519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 68/138] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:12.627124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.634881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.635892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.636454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.637008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8415463a9ba0463aa60cc65278d679e0/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.639476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, user_id=8415463a9ba0463aa60cc65278d679e0, role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.641176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.660345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 71/139] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:12 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8415463a9ba0463aa60cc65278d679e0/roles/92293530e9464e0ea6885885e170633e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:12.664856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.763549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.868952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7d6e9-8e47-46d4-bb20-e58b6cbb24c6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.923214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa31df-4884-429d-8d9c-0a592dd346dd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:12.929977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.930973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.931396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.931808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] PATH_INFO: `/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea/users/8415463a9ba0463aa60cc65278d679e0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.933927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:12.935016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d594f964dbb475bb9d7adf49c1a24ea, user_id=8415463a9ba0463aa60cc65278d679e0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.937195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:12.959222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 69/140] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:12 2022] PUT /identity/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea/users/8415463a9ba0463aa60cc65278d679e0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:12.961118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:12.971810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:12.973128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:12.973823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:12.974441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8a682bb868194e74ab874d8a9a46c89e/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:12.977660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, user_id=8a682bb868194e74ab874d8a9a46c89e, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:12.980348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:13.007946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 72/141] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:12 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/8a682bb868194e74ab874d8a9a46c89e/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:13.125736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dfc6a-c1f2-48d5-ba30-ca8b1825cb03 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:13.141887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:13.181875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:13.182706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:13.183134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:13.183512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:13.185389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:13.186100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:13.187886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:13.190639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 70/142] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:13.198513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:13.366091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76894-ad7e-4bae-9200-b108f993a90d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:13.403195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e689ce-5e3e-4d39-af41-c79a9b020180 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:13.424562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:13.425337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:13.425631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:13.425874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:13.427072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:13.429640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:13.449747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:13.451205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:13.451729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:13.452253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:13.463193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 71/143] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:13 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:13.468478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:13.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:13.476313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:13.477095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:13.479715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 73/144] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:13.486199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:13.554286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:13.675739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c7b6-367a-43de-82f8-b731bf025244 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:13.721111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:13.721822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:13.722097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:13.722372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:13.723069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:13.723373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:13.724799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:13.734893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 72/145] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:13.741617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:13.788880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:13.902863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8af48-c724-4f96-8bf1-591899945d0e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:13.951005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:13.951583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:13.951858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:13.952130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] PATH_INFO: `/v3/users/52ef750fae654354a089c91403af40c7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:13.953607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] RBAC: Authorizing `identity:get_user(user_id=52ef750fae654354a089c91403af40c7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:13.956082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:13.958621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 74/146] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:13 2022] GET /identity/v3/users/52ef750fae654354a089c91403af40c7 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:13.964934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:14.108306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:14.119860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e822e7-6c72-4fe2-967c-15ef5a75738a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:14.180647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:14.181745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:14.182196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:14.182643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:14.184614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:14.187269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb6dd1-ae1d-47e4-8c1e-ae3ac86bdab5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:14.190353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 73/147] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:13 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:14.196371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:14.327642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:14.331722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842c7e2-6005-4621-b924-29482c885b9e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:14.371172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:14.371863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:14.372145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:14.372409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/52ef750fae654354a089c91403af40c7/roles/cd7e0d936ded430b9c1ec6a84e00beaf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:14.374786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, user_id=52ef750fae654354a089c91403af40c7, role_id=cd7e0d936ded430b9c1ec6a84e00beaf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:14.376333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb52f5-b1a5-427d-85d7-6dbcece78231 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:14.397593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 75/148] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:14 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/users/52ef750fae654354a089c91403af40c7/roles/cd7e0d936ded430b9c1ec6a84e00beaf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:14.810842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930569e-8b15-414c-96c9-a4f1b045e4d2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:14.811289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930569e-8b15-414c-96c9-a4f1b045e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:14.811768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930569e-8b15-414c-96c9-a4f1b045e4d2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:14.814567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 74/149] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:14.824423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:14.824998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:14.825455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:14.857924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:14.859810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:14.998770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 76/150] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:15.369637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930569e-8b15-414c-96c9-a4f1b045e4d2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:15.499286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930569e-8b15-414c-96c9-a4f1b045e4d2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:15.538915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:15.539936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:15.540353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:15.540824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:15.555512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:15.560964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:15.562595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:15.564120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 75/151] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:15.569706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:15.702028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:15.726221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908705b4-1086-4cdd-9573-ffd962a1071e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:15.778442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:15.779500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:15.779976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:15.780444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:15.782458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:15.783252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:15.786552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:15.808718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 77/152] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:15.815483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:15.865345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:15.961781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c4259-d933-4aad-b8e6-f3bb1892afec None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:16.002625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:16.003284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:16.003567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:16.003842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:16.005121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:16.006604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded0ae-3a77-4382-bcb2-e966ef3075e3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:16.008238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 76/153] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:15 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:16.014140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:16.160718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aeb72-e744-4a18-9bd8-89b3e0b6a08f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:16.228433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ce8f-9387-4394-9cc6-b4b30a3a38ea None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:16.228645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ce8f-9387-4394-9cc6-b4b30a3a38ea None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:16.229089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59ce8f-9387-4394-9cc6-b4b30a3a38ea None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:16.230651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 77/154] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:16.230800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:16.231245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:16.231577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:16.231847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:16.236868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:16.237217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:16.237471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:16.268136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:16.269814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:16.278723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:16.388066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:16.390045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:16.462390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 78/155] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:16.599192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 78/156] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:16.605824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:16.636566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:16.744354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef986c8-4477-4e41-aeab-62775d008869 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:16.784208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:16.784894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:16.785296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:16.785434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:16.786584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:16.788062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:16.789752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 79/157] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:16 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:16.795817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:16.867400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:16.952067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc74a-799a-45ed-91cc-051900a6f8e1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:17.013668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:17.014630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.015068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.015505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.017755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:17.018258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:17.020693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff642a2-512c-4577-90d9-31cf3288076a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:17.035601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 79/158] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:16 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=801153a9ae764c76a1e10058e403d371 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:17.121443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:17.317430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:17.333292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2847b-dc42-40b4-8fc5-782cae0214ee None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:17.387298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:17.388242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.388689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.389196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.398902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b03c6-394c-4407-81b6-135dfc47b35b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.399300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b03c6-394c-4407-81b6-135dfc47b35b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.399437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b03c6-394c-4407-81b6-135dfc47b35b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.401223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 80/159] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:17.408649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:17.414138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a9bf-72c4-4b4e-8ab9-de02474618bf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.414400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a9bf-72c4-4b4e-8ab9-de02474618bf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.414911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8a9bf-72c4-4b4e-8ab9-de02474618bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:17.422746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:17.425308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:17.426696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 80/160] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:17.432132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:17.467321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5ac8a9bf-72c4-4b4e-8ab9-de02474618bf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:17.468577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5ac8a9bf-72c4-4b4e-8ab9-de02474618bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:17.625869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df98fe3-bbe1-44b6-8ef1-56f3212767d4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:17.696808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:17.698108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.698475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.698868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.700037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:17.700585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:17.705274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341a12f-d166-4d3e-88ba-c717efe2d539 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:17.722118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 81/161] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:17.724381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81762-843f-4ba3-a671-5b17413940f3 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.728983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81762-843f-4ba3-a671-5b17413940f3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.729606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81762-843f-4ba3-a671-5b17413940f3 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.731803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 81/162] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:17.732548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 82/163] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:17.738412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea81762-843f-4ba3-a671-5b17413940f3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:17.747719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:17.748156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:17.748653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:17.790733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:17.820721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:17.822637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:17.951614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:18.041706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 82/164] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:18.055015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea81762-843f-4ba3-a671-5b17413940f3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:18.114319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:18.114989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:18.115266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:18.115545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:18.117277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:18.119374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:18.121093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 83/165] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:17 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:18.127797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:18.317135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65b359-d8a4-4124-bac4-37f0226f64dd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:18.378013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:18.379053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:18.379885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:18.380171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:18.449037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:18.514669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:18.516620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:18.520163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:18.729781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:18.790848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 83/166] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:18.795593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe97fb-604e-4868-9349-8d6eb5cbcfe1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:18.801774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:18.891365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:18.892028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:18.892308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:18.897650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:18.917078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:18.927392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:18.928504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:18.929507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:18.930817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 84/167] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:18.936994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:18.979846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:19.092257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f73e9b-88d7-4c64-a91b-816b7440867d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.135194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221f43b-e435-4a23-b610-665d6175214e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.177404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.178365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.178899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.179582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.181559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.184082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.184298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.184979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.185252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.185522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.188095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 85/168] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:18 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.189675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:19.214500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:19.221172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:19.222758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:19.224383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:19.225314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 84/169] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:19.232803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:19.348301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742adeb-b93d-43d4-9fc3-7dd4fde21809 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.394527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.395770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.396356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.396986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.398239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:19.398941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.401073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.412118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 86/170] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.415009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:19.509444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:19.556795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0930a-22f3-4fba-ba4e-e2bc95dd6244 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.598422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.600154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.600602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.601079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.601933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:19.602380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.604168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8442239-e7ed-41ca-bebe-f5974a086725 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.604669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.614680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 87/171] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.615814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:19.661506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.662768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.663579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.664125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.665657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:19.666356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.669006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a29736-3e89-40d1-9579-5091521953ac None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.672285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:19.685271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 85/172] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:19 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=92293530e9464e0ea6885885e170633e => generated 608 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.687319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08eb-2b84-48e8-9047-f18860a835e6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.687871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08eb-2b84-48e8-9047-f18860a835e6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.688423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b08eb-2b84-48e8-9047-f18860a835e6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.691397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 86/173] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:19.692705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08eb-2b84-48e8-9047-f18860a835e6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:19.850895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d4d5-0d9b-49b3-a09c-e330888adcc5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.895797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:19.910553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.911722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.912260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.913077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] PATH_INFO: `/v3/users/8415463a9ba0463aa60cc65278d679e0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.915081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] RBAC: Authorizing `identity:get_user(user_id=8415463a9ba0463aa60cc65278d679e0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.916962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f15bd-5c77-466c-a9b1-a0191e63fafa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.919665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 88/174] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:19 2022] GET /identity/v3/users/8415463a9ba0463aa60cc65278d679e0 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.921825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617114a0-c3a9-45ed-8706-7e4fffeb93fc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.922364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617114a0-c3a9-45ed-8706-7e4fffeb93fc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.923598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617114a0-c3a9-45ed-8706-7e4fffeb93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.934097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b08eb-2b84-48e8-9047-f18860a835e6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:19.945846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-617114a0-c3a9-45ed-8706-7e4fffeb93fc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:19.947329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-617114a0-c3a9-45ed-8706-7e4fffeb93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:19.989709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:19.990411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.990688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.990961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] PATH_INFO: `/v3/users/8a682bb868194e74ab874d8a9a46c89e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.992368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] RBAC: Authorizing `identity:get_user(user_id=8a682bb868194e74ab874d8a9a46c89e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:19.994768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095135b6-de80-4684-9bb8-b87741126738 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:19.996114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 87/175] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:19 2022] GET /identity/v3/users/8a682bb868194e74ab874d8a9a46c89e => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:19.997285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63f53-b2c1-4a41-8284-d7c1acfd04a4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:19.997689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63f53-b2c1-4a41-8284-d7c1acfd04a4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:19.997831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d63f53-b2c1-4a41-8284-d7c1acfd04a4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:19.999536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 88/176] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:20.000423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2cb0-42c3-49bc-a845-2588c9763196 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.000712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2cb0-42c3-49bc-a845-2588c9763196 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.001037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2cb0-42c3-49bc-a845-2588c9763196 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.002238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 89/177] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:20.002929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2cb0-42c3-49bc-a845-2588c9763196 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:20.048303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 89/178] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:20.051998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae357d-9349-41ee-9443-68c2849d4131 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.051998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae357d-9349-41ee-9443-68c2849d4131 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.051998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae357d-9349-41ee-9443-68c2849d4131 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.051998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 90/179] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:20.052489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae357d-9349-41ee-9443-68c2849d4131 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:20.098345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.154433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2cb0-42c3-49bc-a845-2588c9763196 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:20.201243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:20.201824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.202096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.202361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.227737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae357d-9349-41ee-9443-68c2849d4131 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:20.263858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.278155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:20.278781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.279055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.279322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.294372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:20.296522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb485653-ad66-47fe-914e-ef9b126d778b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:20.368566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:20.370086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5efbc-59ca-4e6b-8337-5773bca017ec None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:20.379963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.438811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 90/180] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:20.439510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c2c9b-7d50-4e48-9f70-1a06cfa29a61 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.439870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c2c9b-7d50-4e48-9f70-1a06cfa29a61 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.440202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c2c9b-7d50-4e48-9f70-1a06cfa29a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.462006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2e7c2c9b-7d50-4e48-9f70-1a06cfa29a61 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:20.463412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2e7c2c9b-7d50-4e48-9f70-1a06cfa29a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:20.506893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 91/181] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:20.506893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.506893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.506893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.528325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:20.530006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:20.564717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.566358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 91/182] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:20.567527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.567804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.568070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.590024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:20.591278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:20.641694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 92/183] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:20.643120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:20.708986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 92/184] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:20.710176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:20.768186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.819591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13bef-42bf-459c-bdc3-8f93b3f632d0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:20.886752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:20.888155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.888605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.889096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.901175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:20.901352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede8f4c-2da3-4780-b15e-9bb1dc01842c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:20.906865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:20.907787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:20.908571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:20.910581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 93/185] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:20.911539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:20.933680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:20.949572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:20.950231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:20.950503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:20.950766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] PATH_INFO: `/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:20.951892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] RBAC: Authorizing `identity:get_project(project_id=3d594f964dbb475bb9d7adf49c1a24ea)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:20.953937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:20.957002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 93/186] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/projects/3d594f964dbb475bb9d7adf49c1a24ea => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:20.960872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.036976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503515e-5206-46f1-a3d3-f16223a7d6cd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.076639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.079320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.079985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.080258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.080531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.082598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.085228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.087108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 94/187] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.089982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.093613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808275ce-1df4-419b-9518-fbaa24f836b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.130862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.131500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.131767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.132025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.135533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.135533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.136235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 94/188] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.137669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.189046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.207046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f710f-807e-4aeb-b9bf-fcaa5e2bbd4c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.245494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.246038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.246315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.246586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.247264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:21.247565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.248968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.255131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361ba1d-2560-4b7c-8c6b-5adff8534c7d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.258374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 95/189] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.259056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.298391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.298998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.299291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.299571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.300281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3d594f964dbb475bb9d7adf49c1a24ea, user.id=8415463a9ba0463aa60cc65278d679e0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:21.300587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.302104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.309144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 95/190] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/role_assignments?user.id=8415463a9ba0463aa60cc65278d679e0&scope.project.id=3d594f964dbb475bb9d7adf49c1a24ea&role.id=801153a9ae764c76a1e10058e403d371 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.309997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.346673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.424935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c1a28-8456-4a86-b7a9-a672e217e92b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.445725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c021bdd-2c45-4ef8-a5fe-f1e86fba8782 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.468920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.469658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.470142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.470530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.483907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:21.493052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:21.494162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:21.494969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 96/191] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:21.495696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.502712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.503349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.503620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.503888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.504656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=8a682bb868194e74ab874d8a9a46c89e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:21.505041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.506494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.513490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.518069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 96/192] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/role_assignments?user.id=8a682bb868194e74ab874d8a9a46c89e&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.518699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.668176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.686843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6a39-5eaa-4bbc-b796-dd6162e41ca5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.692813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4be6-ab7e-4bd6-bf9b-ae11eb149486 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.743175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.744626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.744626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.745083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.753057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.753302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.753763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.754010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.755002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.756552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.758551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:21.764022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:21.765022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:21.766095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 97/193] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:21.769634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.804407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 97/194] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:21 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:21.809849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:21.844105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:21.892016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea700f-5075-4caa-85e9-39d5f51b9412 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.942357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80b90-d422-40bb-8a65-47296195629b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:21.945768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:21.946427 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:21.946763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:21.947043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:21.965691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:21.967210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:21.969069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 98/195] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:21.975136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.005393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.005977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.006258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.006672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.007567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:22.007858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.010237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.021532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 98/196] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:22.025677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.043436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.123830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb424fb-b1ac-4753-9c6c-49a855fcb48d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.163083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.178688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.178688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.178688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.179173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.181081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:22.181208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.183023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.186806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8059c6-1c4d-4092-a84f-8ebcd16baac2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.192935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 99/197] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:22.193661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.231825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.232457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.233022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.233303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.343660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.346182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.351618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.388230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9b96-7d41-4b64-aeff-d3e836db75e9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.464841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.465822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.466099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.466365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] PATH_INFO: `/v3/users/52ef750fae654354a089c91403af40c7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.468900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] RBAC: Authorizing `identity:get_user(user_id=52ef750fae654354a089c91403af40c7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.470649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.473391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 100/198] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/users/52ef750fae654354a089c91403af40c7 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:22.474233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.514495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 99/199] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:22.517241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.554895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.619174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26d2f9-6830-4899-868c-c80cecbb591c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.665011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.665676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.665953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.666222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.667380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.668943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.670813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 101/200] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:22.671698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.702756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8ff9f-18d7-4714-a18f-84b9efb874ce None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.706099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.742922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.743899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.744362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.744847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.783910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424fed5-4368-4bcc-a8c3-b65df1ea1348 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.808394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:22.819733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.820421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.820692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.821080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.822106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.823568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.825041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:22.825482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 102/201] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:22.825995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.827486 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:22.937716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4d3d2-4035-4e29-a484-cf4fe05931a7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:22.972949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 100/202] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:22.973928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:22.974616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:22.974885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:22.975157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:22.975936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:22.982323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:23.038513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:23.048796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.050304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.149443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574040-dc11-470d-9dd4-ee75af13b661 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:23.173153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 103/203] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:23.174630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:23.194143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:23.195886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:23.196622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:23.197443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:23.199356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=e42a981507104542b4627863dab41780, user.id=de09e4c235574009ab9ce09940068cc0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:23.200139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.202056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.209658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 101/204] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:22 2022] GET /identity/v3/role_assignments?user.id=de09e4c235574009ab9ce09940068cc0&scope.project.id=e42a981507104542b4627863dab41780&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:23.210958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:23.284789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:23.295404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e8b1-d080-4469-bf38-29ee50df8b5a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:23.305710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:23.334508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:23.335164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:23.335438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:23.335706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:23.336929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.338471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.340226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 104/205] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:23 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:23.346631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:23.361733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150eed4-963f-4f6c-b2cd-60cf7671bc53 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:23.430780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:23.432425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:23.433173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:23.433888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:23.436401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.439453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.442255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 102/206] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:23 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:23.450358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:23.489844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dba1a-3c7d-4763-bf79-14e41f9414a9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:23.527739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:23.528364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:23.528640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:23.528944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:23.529686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, scope.project.id=3175ea486f38486eb4fb3cef53728d7e, user.id=52ef750fae654354a089c91403af40c7) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:23.529993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.531520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffe2b-478f-49b5-b4a9-a73076e37b99 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.538210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 105/207] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:23 2022] GET /identity/v3/role_assignments?user.id=52ef750fae654354a089c91403af40c7&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:23.576418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9521-db72-4e0e-a72e-13ab1bbdd669 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:23.620593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:23.621608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:23.622099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:23.622558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:23.623485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=e42a981507104542b4627863dab41780, user.id=de09e4c235574009ab9ce09940068cc0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:23.623995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:23.626028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92cca9-f6b7-4350-bf22-56c77138b699 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:23.630090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:23.635197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 103/208] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:23 2022] GET /identity/v3/role_assignments?user.id=de09e4c235574009ab9ce09940068cc0&scope.project.id=e42a981507104542b4627863dab41780&role.id=92293530e9464e0ea6885885e170633e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:24.311868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85aed-e1ed-47c2-b592-54ead7bf99d5 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:24.312400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85aed-e1ed-47c2-b592-54ead7bf99d5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:24.312474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101755-6b6c-4785-b835-34841c41ad8a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:24.312474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101755-6b6c-4785-b835-34841c41ad8a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:24.312989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85aed-e1ed-47c2-b592-54ead7bf99d5 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:24.313059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101755-6b6c-4785-b835-34841c41ad8a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:24.313968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 106/209] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:24.314121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 104/210] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:24.319958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:24.320235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:24.320508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:24.322350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:24.322736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:24.323105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:24.340474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:24.342039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:24.344835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:24.346298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:24.364204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:24.432218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 107/211] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:24.444662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 105/212] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:24.715755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:24.837416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:24.864056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0235c34-8456-4cce-a6c3-e98e2a499493 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:24.911902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:24.912957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:24.913399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:24.913855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:24.932426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:24.944412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:24.945603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:24.946406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 108/213] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:24.953794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:24.968949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f17589-75ca-41a3-85c8-9d82b61cec07 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:24.993709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:25.012827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:25.023733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.024911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.025637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.026537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.028168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.030777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.034037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 106/214] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:25.040396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:25.079254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f8c0b-e276-4f8e-952b-8fe0dbe16b1b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:25.122652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.123515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.124300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.124718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.125683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:25.126123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.127843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.137697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 109/215] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:25.146903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:25.169859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44caf3-38ae-4582-a3f8-aefb460f8c26 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:25.220185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.221600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.221875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.223412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.224107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.225656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.259570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 107/216] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:25 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:25.261754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:25.290419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13787b7-f001-4fb1-86ac-7448608fcfee None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:25.350228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.352214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.352796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.353265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] PATH_INFO: `/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.377939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] RBAC: Authorizing `identity:get_user(user_id=efa9ddcfa7134c3dbe6bd1232aee0af9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.379559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0833f-d5f5-4918-b91b-a9466aa02454 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.386802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 110/217] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:25 2022] GET /identity/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:25.388392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:25.461325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:25.510112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543a2f-a520-4b1c-ac37-65f4a48aa749 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:25.549335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.549975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.550251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.550514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.628425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.631255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.695462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:25.740292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520762d1-9016-49cf-9c3d-ed44641c4a56 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.740635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520762d1-9016-49cf-9c3d-ed44641c4a56 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.740940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520762d1-9016-49cf-9c3d-ed44641c4a56 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.742402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 111/218] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:25.749922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99736-5728-42f9-bedc-3b66fb10513a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.750199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99736-5728-42f9-bedc-3b66fb10513a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.750665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99736-5728-42f9-bedc-3b66fb10513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.752585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 108/219] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:25.759124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:25.783758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-33d99736-5728-42f9-bedc-3b66fb10513a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:25.785377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-33d99736-5728-42f9-bedc-3b66fb10513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:25.869256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a44af-f68e-492f-80fd-11d94fb310e1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:25.917712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:25.918611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.918882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.919150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.922750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:25.925098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:25.926834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 109/220] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:25 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:25.934143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:25.936611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 112/221] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:25.968037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb407-2cb9-4588-a21c-397b62d26945 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.968344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb407-2cb9-4588-a21c-397b62d26945 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.968575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abb407-2cb9-4588-a21c-397b62d26945 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.970068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 113/222] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:25.975634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:25.975934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:25.976179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:25.979193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:26.002062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:26.003262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:26.092836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:26.116405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 114/223] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:26.165913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9f21f-d765-4686-b0c6-de6f271897d9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:26.225459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:26.226485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:26.226956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:26.227421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:26.228384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=e42a981507104542b4627863dab41780, user.id=efa9ddcfa7134c3dbe6bd1232aee0af9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:26.228926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:26.230576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:26.237690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 110/224] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:25 2022] GET /identity/v3/role_assignments?user.id=efa9ddcfa7134c3dbe6bd1232aee0af9&scope.project.id=e42a981507104542b4627863dab41780&role.id=801153a9ae764c76a1e10058e403d371 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:26.346703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:26.471454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1fa4f-7d4d-404b-8809-7cab4a58dfd6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:26.477576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:26.509298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:26.509935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:26.510209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:26.510474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:26.542925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:26.548092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:26.549757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:26.551277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 115/225] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:26.558073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:26.620440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:26.646578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f0bc-64f5-468a-ac8c-b0ccb26fcee8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:26.685325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:26.686211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:26.686584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:26.687030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:26.700421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:26.704873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:26.710541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:26.711603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:26.712395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:26.713043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 111/226] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:26.718726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:26.836970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3a2aa-6823-44fe-b22e-0306c255f7be None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:26.851972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba380922-d1b9-4287-90ac-465ff644b18c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:26.909226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:26.909995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:26.910337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:26.910676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:26.911466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:26.911835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:26.913368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:26.923513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 112/227] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:26.929529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:26.946846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:26.963517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:26.964701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:26.965366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:26.965924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:26.967167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:26.967682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:26.978582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.009327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 116/228] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:27.016168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:27.070986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbc7e7-f837-4545-b664-f201f685080b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.142560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.143690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.144072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.144414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.145902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.147572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.157962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 113/229] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:26 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:27.158888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:27.226701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9db5b-13da-4c52-9f65-6330cdad3533 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.255163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:27.286559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:27.300493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.301615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.302097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.302575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.309981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.312075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.319286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 117/230] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:27 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:27.320332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28f17b-bf68-497b-a469-12fd4016911e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.327587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:27.396905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.398471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.399847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.400841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.403129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.407058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.415718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 114/231] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:27 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:27.421539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:27.622866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164fab-0be9-417b-a2c2-b44eebd1fe72 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.689306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a021223-fa7a-4fad-8b76-65ea22c06fe3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.726622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.727652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.728127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.728591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.735989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.739009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.741469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.742169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.742506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.742657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 118/232] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:27 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:27.742789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/users/de09e4c235574009ab9ce09940068cc0/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.746570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, user_id=de09e4c235574009ab9ce09940068cc0, role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.748041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088f359-d3eb-4d20-833d-a74b6c3a0f4c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.749636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:27.777990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 115/233] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:27 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/users/de09e4c235574009ab9ce09940068cc0/roles/92293530e9464e0ea6885885e170633e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:59:27.844037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:27.910763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3e09f-5236-4608-936d-cafcc386ed4d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:27.933255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ab9a-e04d-45e9-abb7-b95fd46ad39b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.933611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ab9a-e04d-45e9-abb7-b95fd46ad39b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.933867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977ab9a-e04d-45e9-abb7-b95fd46ad39b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.935362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 116/234] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:27.942639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608b9c8-2e94-4327-8cfe-226e5f40cea6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.943504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608b9c8-2e94-4327-8cfe-226e5f40cea6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.943978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608b9c8-2e94-4327-8cfe-226e5f40cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.953203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:27.959458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:27.960168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:27.960447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:27.960720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/users/de09e4c235574009ab9ce09940068cc0/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:27.963266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, user_id=de09e4c235574009ab9ce09940068cc0, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:27.964926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9778e-40a4-4a24-812b-52e4f85cf517 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:27.972911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f608b9c8-2e94-4327-8cfe-226e5f40cea6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:27.975003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f608b9c8-2e94-4327-8cfe-226e5f40cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:27.991280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 119/235] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:27 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/users/de09e4c235574009ab9ce09940068cc0/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:28.088800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 117/236] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:28.091095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450aace-810d-40aa-be06-81e6f326291d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.091379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450aace-810d-40aa-be06-81e6f326291d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.091654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450aace-810d-40aa-be06-81e6f326291d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.093481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 120/237] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:28.099621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.100226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.100695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.125416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:28.127691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:28.232689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 118/238] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:28.462473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450aace-810d-40aa-be06-81e6f326291d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:28.592201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450aace-810d-40aa-be06-81e6f326291d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:28.606912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:28.639399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:28.639590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:28.640225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.640389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.640643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.641987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:28.643463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:28.646369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 121/239] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:28.653722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:28.790896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455f633-ccc8-4f53-bec5-f9847d8d3ba0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:28.832561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:28.833513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.834421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.834953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.836020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:28.837683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf975a3-6232-4053-8e69-1ce275aec6b3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:28.864270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 122/240] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:28 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:59:28.866543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:28.932250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b07a94-42dd-4cfd-9fa3-1be55fc1ed12 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.932979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b07a94-42dd-4cfd-9fa3-1be55fc1ed12 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.933579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b07a94-42dd-4cfd-9fa3-1be55fc1ed12 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.935820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 123/241] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:28.942854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:28.943495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:28.943992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:28.967555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:28.969438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:28.974283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b1d52-684b-4f4b-87a4-87f2718f75c4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:29.022507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:29.082223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:29.083296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:29.083804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:29.084259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:29.094064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 124/242] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:29.107246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:29.117848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:29.119689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:29.121552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:29.126324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 119/243] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:29.133285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:29.321402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87aec2-9716-4294-ac35-4fe11110d15e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:29.383922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:29.385214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:29.385865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:29.386494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:29.387826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:29.388509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:29.390414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:29.403939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 125/244] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:29.415782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:29.565931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a6a3-5227-4df8-a20c-88575a867fa1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:29.597552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:29.610157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:29.611548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:29.612268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:29.612546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:29.612889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] PATH_INFO: `/v3/users/e5053d817dcc4690b538d355619fb8a7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:29.633110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] RBAC: Authorizing `identity:get_user(user_id=e5053d817dcc4690b538d355619fb8a7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:29.634834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:29.636776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 120/245] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:29 2022] GET /identity/v3/users/e5053d817dcc4690b538d355619fb8a7 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:29.644936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:29.698599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:29.798264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff3a7c-0825-45c0-a456-eb7c731ee472 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:29.838781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:29.839511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:29.839788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:29.840205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:29.847935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab2cb2-1688-4644-a9c5-5af83031f882 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:29.896435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:29.921382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:29.923294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:29.926897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:29.927635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:29.927917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:29.928192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:29.952064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:29.965591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:29.966562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:29.967372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:29.968469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 126/246] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:29.974854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.046082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 121/247] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:30.052682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.157458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:30.164767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:30.191683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377289bb-d481-49cb-a5a9-07b71ee6abff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:30.197052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a487a-a8ed-480e-9f46-5f613715a92f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:30.281855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:30.282741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.283070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.283500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.284493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:30.284966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:30.286994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:30.294748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:30.295625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.296040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.296438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.297939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:30.299695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:30.301437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 122/248] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:30 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:30.309337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.315216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 127/249] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:30.323250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.492545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956222da-6dea-4172-ae7d-181d3c31bab7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:30.529714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:30.530358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.530632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.530900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] PATH_INFO: `/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.532499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] RBAC: Authorizing `identity:get_user(user_id=efa9ddcfa7134c3dbe6bd1232aee0af9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:30.534028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:30.535993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 128/250] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:30 2022] GET /identity/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:30.547530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.568914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443b95-c05f-445d-8bd4-090e7aaf8f69 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:30.577243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:30.660373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:30.661126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.661405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.661682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.662530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, scope.project.id=e42a981507104542b4627863dab41780, user.id=e5053d817dcc4690b538d355619fb8a7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:30.662977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:30.664529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:30.671183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 123/251] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:30 2022] GET /identity/v3/role_assignments?user.id=e5053d817dcc4690b538d355619fb8a7&scope.project.id=e42a981507104542b4627863dab41780&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:30.733413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4816d2-11b0-42d4-837a-1eda199d6329 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:30.796691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:30.797655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.798075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.798352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.803907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:30.805561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c69e-1d7e-4b32-a3ef-d33be93f55fe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:30.807403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:30 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:30.817938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:30.848497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:30.928231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699564-4bcc-489f-8a39-97bcdd90b66e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.928718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699564-4bcc-489f-8a39-97bcdd90b66e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.929017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699564-4bcc-489f-8a39-97bcdd90b66e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.930664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 130/253] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:30.936236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161b21-28b7-4143-aa4b-b59e69d70d70 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:30.936517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161b21-28b7-4143-aa4b-b59e69d70d70 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:30.936926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161b21-28b7-4143-aa4b-b59e69d70d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:30.980369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-00161b21-28b7-4143-aa4b-b59e69d70d70 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:30.981757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-00161b21-28b7-4143-aa4b-b59e69d70d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:30.987632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15a7a7-f438-4dbe-9b77-28ad107fd163 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:31.040445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:31.041420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:31.041844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:31.042310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/users/efa9ddcfa7134c3dbe6bd1232aee0af9/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:31.044626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, user_id=efa9ddcfa7134c3dbe6bd1232aee0af9, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:31.051224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b530b-3c3c-4cc3-8195-8a6278ac6b9a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:31.077200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 124/254] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:30 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/users/efa9ddcfa7134c3dbe6bd1232aee0af9/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:31.135365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 131/255] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:31.173696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df8c-f4de-4629-abd8-1691913e90b7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:31.173989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df8c-f4de-4629-abd8-1691913e90b7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:31.174324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df8c-f4de-4629-abd8-1691913e90b7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:31.175796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 125/256] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:31.182002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:31.182294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:31.182617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:31.207615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:31.208951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:31.227825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:31.322452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 132/257] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:31.756781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1df8c-f4de-4629-abd8-1691913e90b7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:31.820683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:31.889540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:31.954977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1df8c-f4de-4629-abd8-1691913e90b7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.005184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3fa14-15c8-421f-ad7c-ea4913817802 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.040335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.041897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.042376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.042843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.044515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.045234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.045507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.045772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.058957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:32.065004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:32.066225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:32.067035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 133/258] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:32.073974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.077103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:32.084070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:32.085079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:32.085916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:32.086629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:32.095627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 126/259] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:32.101710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.266574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39024e7e-8ff2-461a-88ed-11c94760a0d1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.324214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.324869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.325147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.325415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.326086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:32.326392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:32.327787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:32.338947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f990b9-2060-4315-a1cb-a823da3eb213 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.344790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 134/260] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:32.349153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.426127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.427114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.427558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.428007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.429185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:32.429696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:32.432732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:32.433408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:32.453527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 127/261] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:32.460304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.498133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:32.574078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0975b2-9486-4ab7-ba6b-d5f5f21338ac None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.655366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.656313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.656789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.657200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.660997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:32.662811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce9c62-07e3-4ad9-920a-0c7f105f6821 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:32.664705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 135/262] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:32.669425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8839231-4a79-4f6b-b1e3-f986ee64e71f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.670612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8839231-4a79-4f6b-b1e3-f986ee64e71f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.672887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8839231-4a79-4f6b-b1e3-f986ee64e71f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.674588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 136/263] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:32.682305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8839231-4a79-4f6b-b1e3-f986ee64e71f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.703090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4646d2-c2f1-4ebc-89c9-c4f39da616a3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.749430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.750588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.751206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.751787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] PATH_INFO: `/v3/users/de09e4c235574009ab9ce09940068cc0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.753432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] RBAC: Authorizing `identity:get_user(user_id=de09e4c235574009ab9ce09940068cc0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:32.755064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970998d-4584-48e8-be47-d8c69439cff9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:32.756954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 128/264] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/users/de09e4c235574009ab9ce09940068cc0 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:32.758302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.758763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.759282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.785030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:32.786430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:32.880294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8839231-4a79-4f6b-b1e3-f986ee64e71f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:32.894094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:32.905313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 129/265] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:32.907012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:32.941916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:32.943121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:32.945336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:32.946367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:32.957139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.096090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.101904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e8c4-d4c2-47bd-a991-e9866969ec94 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.130396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab2b66-0429-421e-89aa-44e0d03218b9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.213669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.214614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.214896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.215167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.227881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 137/266] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:33.229239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6033c8-10fa-4d98-88c9-11a0fec89f63 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.229677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6033c8-10fa-4d98-88c9-11a0fec89f63 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.230496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6033c8-10fa-4d98-88c9-11a0fec89f63 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.232367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 138/267] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:33.238347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6033c8-10fa-4d98-88c9-11a0fec89f63 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.289201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.295903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.309714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.312609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93c53e-4f19-4d26-9fca-affb00b7dd1f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.364562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6033c8-10fa-4d98-88c9-11a0fec89f63 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.407007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.407939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.408215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.408483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.421565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:33.427151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:33.428144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:33.428978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 139/268] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:33.429642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.451331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 130/269] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:33.453677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.454255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.454745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.475506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:33.478125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:33.553371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.561616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 131/270] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:33.562950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.569551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375c2e-91c4-495f-ae17-d727ce814526 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.593204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.629028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.629843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.630122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.630388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.631568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.633129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.635149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 140/271] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:33.635873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.688980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bcbce-3e00-4080-b1df-e4b5b6242a15 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.728404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.729847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.730362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.730836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.731723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:33.732248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.733964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405f685-e68d-4543-b1c3-02e1bdb0828c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.745678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 132/272] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:33.752913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11eb9f-d3af-4e71-ac17-f0d40f9ed4b4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.754282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802022-d029-409f-ae7e-089dc1705da6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.754792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802022-d029-409f-ae7e-089dc1705da6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.755275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802022-d029-409f-ae7e-089dc1705da6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.756902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 133/273] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:33.757878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802022-d029-409f-ae7e-089dc1705da6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.795960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.796658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.797377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.797377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.799458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.802609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.811511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 141/274] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:33.812314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:33.853213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.867897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:33.889813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802022-d029-409f-ae7e-089dc1705da6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.949128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517944f-4615-458f-bdab-7e69079679be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:33.949862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517944f-4615-458f-bdab-7e69079679be None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.950296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517944f-4615-458f-bdab-7e69079679be None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.950623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517944f-4615-458f-bdab-7e69079679be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.951440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517944f-4615-458f-bdab-7e69079679be None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=e42a981507104542b4627863dab41780, user.id=de09e4c235574009ab9ce09940068cc0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:33.951741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517944f-4615-458f-bdab-7e69079679be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:33.954319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517944f-4615-458f-bdab-7e69079679be None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:33.968799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 134/275] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/role_assignments?user.id=de09e4c235574009ab9ce09940068cc0&scope.project.id=e42a981507104542b4627863dab41780&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:33.968799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:33.968799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:33.968799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:33.969364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad929af-e2a3-4621-a1a0-aef2e409a572 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:33.995964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:33.997490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:34.020837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.021603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.021888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.022159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] PATH_INFO: `/v3/users/fba5ec45cf0a46838ada8445dfd8485d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.039869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] RBAC: Authorizing `identity:get_user(user_id=fba5ec45cf0a46838ada8445dfd8485d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:34.041455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:34.048520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 142/276] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:33 2022] GET /identity/v3/users/fba5ec45cf0a46838ada8445dfd8485d => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:34.048520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.088307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 135/277] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:34.089552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.197411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:34.211898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b6a7-9df5-4283-99c6-a45a638d9e3f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.238347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:34.273120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbef59-d97a-4776-969c-10e8592a9bd9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.278638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.279782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.280440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.280865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.282035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=e42a981507104542b4627863dab41780, user.id=de09e4c235574009ab9ce09940068cc0) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:34.283089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:34.285014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b041f3-c331-4d99-8393-e0b722e5b291 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:34.294946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 143/278] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/role_assignments?user.id=de09e4c235574009ab9ce09940068cc0&scope.project.id=e42a981507104542b4627863dab41780&role.id=92293530e9464e0ea6885885e170633e => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:34.296397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4709-670e-48eb-bfa3-f894357ad732 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.296779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4709-670e-48eb-bfa3-f894357ad732 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.297984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4709-670e-48eb-bfa3-f894357ad732 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.299582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 144/279] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:34.304897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4709-670e-48eb-bfa3-f894357ad732 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.341163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.342070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.342473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.342990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.344714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:34.346702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77b176-faa1-4cff-b54a-c61d7695adaa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:34.349298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 136/280] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:34.350934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.351346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.351817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.376290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:34.378079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:34.457972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4709-670e-48eb-bfa3-f894357ad732 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.473455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 137/281] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:34.474345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.508236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.509290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.509770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.510100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.510895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, user.id=fba5ec45cf0a46838ada8445dfd8485d, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:34.511263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:34.513587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:34.521220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 145/282] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/role_assignments?user.id=fba5ec45cf0a46838ada8445dfd8485d&scope.system=all&role.id=801153a9ae764c76a1e10058e403d371 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:34.522748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.555965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:34.625136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:34.662971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0a28-10e0-439c-a8f7-b99c0c0e4bd0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.697435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87323d-4c4c-407d-8c9c-487f7753e9d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.720734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.722002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.722988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.723552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.724782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:34.728353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:34.761681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 138/283] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 19:59:34 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:34.773365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:34.774450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:34.774905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:34.775444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:34.794804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:34.800740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:34.802117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:34.803014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:34.803869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 146/284] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:34.812362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:34.940174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:34.964896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeeeb-e3cb-499e-8a10-3240489ac580 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:34.979010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9df7b-c197-4805-a2c7-0392d0876cc1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.020085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.021535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.021820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.022093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.024262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:35.030499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.031395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.031606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.031874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.033019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:35.033325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.034965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.039287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:35.046423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:35.047448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:35.048660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:35.049363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 147/285] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:35.050241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 139/286] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:35.055802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.059177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.199699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28141673-6e82-41af-88bb-e90ec2454be4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.207709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef327ed-79a9-4a91-ba58-f7f2a093a323 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.248024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.249668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.250255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.250727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] PATH_INFO: `/v3/users/e5053d817dcc4690b538d355619fb8a7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.252293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] RBAC: Authorizing `identity:get_user(user_id=e5053d817dcc4690b538d355619fb8a7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.252943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.253574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.253893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.254322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.255479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.255684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:35.255989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.257581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.258434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 148/287] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/users/e5053d817dcc4690b538d355619fb8a7 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:35.264698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.268677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 140/288] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:35.274845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.282075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:35.357148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:35.435225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1b2b-9b3b-47c5-883b-d968fe6ebd3c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.472225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0541-dcb0-44ad-9703-d821f2086007 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.519711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.520610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.521121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.521538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] PATH_INFO: `/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.522888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] RBAC: Authorizing `identity:get_user(user_id=efa9ddcfa7134c3dbe6bd1232aee0af9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.524521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.526700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 141/289] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/users/efa9ddcfa7134c3dbe6bd1232aee0af9 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:35.533753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.535046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.535714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.536004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.536453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.538512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.540696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.543703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 149/290] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:35.554279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:35.649417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760418-4764-4602-a2a0-2a9db3a30787 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.696484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:35.705728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.707401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.708164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.708657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.725151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:35.760545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4d8b0-c06d-4104-b269-b8965fa39647 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:35.787275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.789110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.830260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:35.830946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:35.831345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:35.831775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/users/e5053d817dcc4690b538d355619fb8a7/roles/cd7e0d936ded430b9c1ec6a84e00beaf` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:35.838342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, user_id=e5053d817dcc4690b538d355619fb8a7, role_id=cd7e0d936ded430b9c1ec6a84e00beaf)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:35.839858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:35.871188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 150/291] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 19:59:35 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/users/e5053d817dcc4690b538d355619fb8a7/roles/cd7e0d936ded430b9c1ec6a84e00beaf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:35.906233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 142/292] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:35.914309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:36.077772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0756f35-b4dd-4ddf-9877-d0022b379c57 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:36.133404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:36.134061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:36.134340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:36.134613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:36.137619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:36.139088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdb1ed-65d4-498d-9a0d-cf93babf2720 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:36.141488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 151/293] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:35 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:36.149086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:36.178430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:36.259175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebd082-aaf2-467c-a3e2-9df7912825a3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:36.304293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:36.304955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:36.305248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:36.305495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:36.306251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=e42a981507104542b4627863dab41780, user.id=efa9ddcfa7134c3dbe6bd1232aee0af9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:36.306543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:36.307987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e71790-119c-4088-b9dc-4abcc92b9d46 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:36.314699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 143/294] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:36 2022] GET /identity/v3/role_assignments?user.id=efa9ddcfa7134c3dbe6bd1232aee0af9&scope.project.id=e42a981507104542b4627863dab41780&role.id=801153a9ae764c76a1e10058e403d371 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:36.783073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47e33-a191-4bb9-b485-30403b5d0f79 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:36.783405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47e33-a191-4bb9-b485-30403b5d0f79 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:36.783613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47e33-a191-4bb9-b485-30403b5d0f79 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:36.785011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 152/295] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:36.790549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed20ef-46a3-466b-8c0d-ba11d02b2ba0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:36.790829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed20ef-46a3-466b-8c0d-ba11d02b2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:36.791099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed20ef-46a3-466b-8c0d-ba11d02b2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:36.810804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-47ed20ef-46a3-466b-8c0d-ba11d02b2ba0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:36.812537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-47ed20ef-46a3-466b-8c0d-ba11d02b2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:36.895973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 144/296] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:37.190462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f47e33-a191-4bb9-b485-30403b5d0f79 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.194731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:37.320897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f47e33-a191-4bb9-b485-30403b5d0f79 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:37.359434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:37.361165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.361589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.361999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.369203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0860f-d0fb-4134-be09-35ef0628880d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.369706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0860f-d0fb-4134-be09-35ef0628880d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.369813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0860f-d0fb-4134-be09-35ef0628880d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.371331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 145/297] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:37.376834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:37.377104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60787e-cff1-4fd8-a284-0b8adfd1cc68 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.377392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60787e-cff1-4fd8-a284-0b8adfd1cc68 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.377660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60787e-cff1-4fd8-a284-0b8adfd1cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:37.384900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:37.386105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:37.387070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:37.390547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 153/298] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:37.396497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.403508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ba60787e-cff1-4fd8-a284-0b8adfd1cc68 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:37.405031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ba60787e-cff1-4fd8-a284-0b8adfd1cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:37.421195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:37.466369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:37.485799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 146/299] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:37.487270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab22a-f917-49df-bf79-4d3464237d3e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.487538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab22a-f917-49df-bf79-4d3464237d3e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.487807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab22a-f917-49df-bf79-4d3464237d3e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.489244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 147/300] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:37.494497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.494766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.495240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.514376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:37.516306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:37.521259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccacf-74e5-45f1-b5ba-9dbf6e5ecb5b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:37.564673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:37.565331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.565605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.565891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.566539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:37.566838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:37.568231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:37.581631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 154/301] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:37.585253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.614111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 148/302] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:37.703311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1023a-05ab-49c4-bfae-31d8ed612671 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:37.732771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:37.749379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:37.750252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.750805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.751275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] PATH_INFO: `/v3/users/fba5ec45cf0a46838ada8445dfd8485d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.752726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] RBAC: Authorizing `identity:get_user(user_id=fba5ec45cf0a46838ada8445dfd8485d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:37.754612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:37.757271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 155/303] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/users/fba5ec45cf0a46838ada8445dfd8485d => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:37.765004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.783625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.878884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:37.909022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034e7c-8c65-433e-9c59-565b6b589309 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:37.915762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe35a-99e0-446c-a4a4-1d908b35debb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:37.953499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:37.954139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.954415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.954682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.956567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:37.957666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:37.957927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:37.958360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] PATH_INFO: `/v3/system/users/fba5ec45cf0a46838ada8445dfd8485d/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:37.960457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fba5ec45cf0a46838ada8445dfd8485d, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:37.962453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:37.966686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:37.973214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:37.974399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:37.975310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 156/304] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:37.976054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:37.983492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 149/305] 10.222.0.61 () {58 vars in 1334 bytes} [Mon Aug 29 19:59:37 2022] PUT /identity/v3/system/users/fba5ec45cf0a46838ada8445dfd8485d/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:37.984830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:38.059703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:38.118691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e114d-3c92-4902-a189-8ee838a6858b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:38.120859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718ff1-77ed-49f0-b7d5-1b8bcc610c86 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:38.163717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:38.164621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.164926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.165220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.165884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:38.166181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:38.167606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:38.173639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:38.176012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.176709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.177018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.178634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:38.178744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 150/306] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:38.179860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:38.184824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 157/307] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:38.185272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:38.187607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:38.190444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:38.323600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5ea4b-3c8f-4cce-9702-0a61e2f98e81 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:38.334601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cb30f-0cb7-40a0-bea1-c92890e8a263 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:38.354040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:38.370914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:38.371545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.371818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.372093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] PATH_INFO: `/v3/groups` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.372738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:38.374540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0507d10-f349-46e6-bed6-bd1f490eed38 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:38.386548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:38.387963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.388405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.388923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] PATH_INFO: `/v3/users/b7b9c1be71364e99b4088fd3eea934ea` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.393957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 158/308] 10.222.0.61 () {60 vars in 1134 bytes} [Mon Aug 29 19:59:38 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:38.401840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7303-38a5-4dff-84b6-37b6c061ce16 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.401840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7303-38a5-4dff-84b6-37b6c061ce16 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.401840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7303-38a5-4dff-84b6-37b6c061ce16 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.401840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 159/309] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:38.403574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.403838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.404117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.414246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b9c1be71364e99b4088fd3eea934ea)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:38.416138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:38.418236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 151/310] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:38 2022] GET /identity/v3/users/b7b9c1be71364e99b4088fd3eea934ea => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:38.426155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:38.432452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:38.433712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:38.547649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:38.572338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 160/311] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:38.614660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2103e2-876a-4a81-a07c-dda5d0761975 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:38.660793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:38.661777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:38.662269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:38.662773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:38.663769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, user.id=b7b9c1be71364e99b4088fd3eea934ea, scope.system=all) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:38.664304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:38.665997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:38.672925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 152/312] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Aug 29 19:59:38 2022] GET /identity/v3/role_assignments?user.id=b7b9c1be71364e99b4088fd3eea934ea&scope.system=all&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:38.897345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:39.023786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc1382-3c77-480a-8cdc-a2c86514b45e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:39.039051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:39.067615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:39.068257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:39.068530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:39.068829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:39.080647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:39.085575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:39.086471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:39.087336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 161/313] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:39.094864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:39.212287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1c08-fae2-40eb-b90b-a5e434e398d8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:39.244104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:39.256133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:39.257136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:39.257637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:39.258102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:39.258972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:39.259514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:39.261167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:39.270648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 153/314] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:39.276559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:39.407841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8006eb-87ad-4935-a5b5-29033d46df63 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:39.445521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:39.446161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:39.446434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:39.446702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] PATH_INFO: `/v3/users/e5053d817dcc4690b538d355619fb8a7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:39.447851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5053d817dcc4690b538d355619fb8a7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:39.449465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:39.451069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 162/315] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:39 2022] GET /identity/v3/users/e5053d817dcc4690b538d355619fb8a7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:39.457700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:39.575625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb624410-e1d5-4f50-bb7a-0c6a96403d63 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:39.615258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:39.615925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:39.616200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:39.616473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:39.681164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:39.691283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:39.692741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:39.802435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 154/316] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:39.810819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:39.857345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:39.926313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae80a0-9d9d-4ef0-a3f5-1acdde7cdfd4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:39.963579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:39.964216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:39.964494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:39.964771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:39.965982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:39.967491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61f7be-180f-4e51-90c6-425d7a8e0706 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:39.969610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 163/317] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:39 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:39.975604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:40.068421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2f36-1b8a-4580-bd45-60c9306f5226 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.068849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2f36-1b8a-4580-bd45-60c9306f5226 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.069003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2f36-1b8a-4580-bd45-60c9306f5226 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.070762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 164/318] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:40.077257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b79a3-6461-479e-9fc3-c4b71d62453a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.077603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b79a3-6461-479e-9fc3-c4b71d62453a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.077896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b79a3-6461-479e-9fc3-c4b71d62453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.098320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-598b79a3-6461-479e-9fc3-c4b71d62453a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:40.098995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:40.099687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-598b79a3-6461-479e-9fc3-c4b71d62453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:40.120629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9c8ad-fb8f-4400-b0dd-555e734ca28a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:40.161310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:40.161926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.162192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.162454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.163188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, scope.project.id=e42a981507104542b4627863dab41780, user.id=e5053d817dcc4690b538d355619fb8a7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:40.163480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:40.165031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:40.171888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 155/319] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 19:59:39 2022] GET /identity/v3/role_assignments?user.id=e5053d817dcc4690b538d355619fb8a7&scope.project.id=e42a981507104542b4627863dab41780&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:40.192542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 165/320] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:40.472691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:40.585058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12aaf7-babd-446c-9a2e-148396948227 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:40.598558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0831-3127-4d92-937e-bf44e3b9edc4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.599156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0831-3127-4d92-937e-bf44e3b9edc4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.599156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0831-3127-4d92-937e-bf44e3b9edc4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.600645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 166/321] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:40.606032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9c74-0ad7-40a3-aa35-01c2b66f529b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.606314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9c74-0ad7-40a3-aa35-01c2b66f529b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.606580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9c74-0ad7-40a3-aa35-01c2b66f529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.626307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:40.626949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.627222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.627489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.629459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-eb1b9c74-0ad7-40a3-aa35-01c2b66f529b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:40.631037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eb1b9c74-0ad7-40a3-aa35-01c2b66f529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:40.639229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:40.644684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:40.645878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:40.646713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 156/322] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:40.651657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:40.668769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:40.675348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:40.732117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 167/323] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:40.770077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232a44f-b83f-45c9-8dc6-92750ca8288a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:40.807125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:40.807737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.808005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.808265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.808954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:40.809234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:40.810710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:40.819996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 157/324] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:40.824506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db67a-9ee4-4154-9c35-736f05a794a2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.824856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db67a-9ee4-4154-9c35-736f05a794a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.825063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:40.825186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db67a-9ee4-4154-9c35-736f05a794a2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.826586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 168/325] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:40.832144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.832674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.833161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.854244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:40.855460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:40.912246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:40.933755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 169/326] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:40.941686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee649e1-c318-4f2c-bae2-d7ca7fdd78ab None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:40.980026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:40.980665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:40.980971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:40.981410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] PATH_INFO: `/v3/users/fba5ec45cf0a46838ada8445dfd8485d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:40.982634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] RBAC: Authorizing `identity:get_user(user_id=fba5ec45cf0a46838ada8445dfd8485d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:40.984086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:40.991089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 158/327] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:40 2022] GET /identity/v3/users/fba5ec45cf0a46838ada8445dfd8485d => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:40.992200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.002847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.106882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:41.112217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ff1d9-255e-4452-b8e1-c22a13cd13a2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.133803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf55e9b-2f94-4276-abce-ba54537a2f8c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.160423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.161075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.161344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.161604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.162444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] RBAC: Adding query filter params (role.id=801153a9ae764c76a1e10058e403d371, user.id=fba5ec45cf0a46838ada8445dfd8485d, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:41.162754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.164334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.172094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.173030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.173313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.173583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.174773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.176210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.177832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 159/328] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 19:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:41.181035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 170/329] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Aug 29 19:59:40 2022] GET /identity/v3/role_assignments?user.id=fba5ec45cf0a46838ada8445dfd8485d&scope.system=all&role.id=801153a9ae764c76a1e10058e403d371 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:41.183705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.199565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:41.204911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.327203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7085a-88b3-4b7b-9bd7-1b72674c6fbd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.343095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf882b-3c85-401b-b12c-584ed8c55ab5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.372205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.372899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.373175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.373781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] PATH_INFO: `/v3/groups` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.374753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.377165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.385174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.385830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.386193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.386365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.398854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 160/330] 10.222.0.61 () {60 vars in 1134 bytes} [Mon Aug 29 19:59:41 2022] POST /identity/v3/groups => generated 226 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:59:41.399030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:41.404550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:41.405672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:41.407183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:41.408932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 171/331] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:41.413956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.503127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:41.543635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc3567-7c3c-4247-b311-5187ff9afdd2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.584101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.584643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.585015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.585278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.585934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:41.586232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.587603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.598047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 161/332] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:41.603756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.624443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:41.722510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fe0ec-e800-4f4a-8fd6-48ee78901360 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.762220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.762957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.763248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.763576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] PATH_INFO: `/v3/users/b7b9c1be71364e99b4088fd3eea934ea` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.765063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b9c1be71364e99b4088fd3eea934ea)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.766860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e21bfc-482b-4aa9-8294-c1d35efad6e4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.769013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 172/333] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:41 2022] GET /identity/v3/users/b7b9c1be71364e99b4088fd3eea934ea => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:41.775809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:41.910377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c3680-0fd4-4968-8159-b2ddddb7fa73 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:41.942482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:41.959056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:41.960612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:41.961146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:41.961649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] PATH_INFO: `/v3/system/users/b7b9c1be71364e99b4088fd3eea934ea/roles/cd7e0d936ded430b9c1ec6a84e00beaf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:41.965044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b7b9c1be71364e99b4088fd3eea934ea, role_id=cd7e0d936ded430b9c1ec6a84e00beaf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:41.966979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16bff4-4567-4618-a981-604ba7340a6a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:41.976581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 162/334] 10.222.0.61 () {58 vars in 1334 bytes} [Mon Aug 29 19:59:41 2022] PUT /identity/v3/system/users/b7b9c1be71364e99b4088fd3eea934ea/roles/cd7e0d936ded430b9c1ec6a84e00beaf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:43.860223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1faa-e24a-40c0-b3ec-600563ae1f04 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:43.860805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1faa-e24a-40c0-b3ec-600563ae1f04 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:43.860805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1faa-e24a-40c0-b3ec-600563ae1f04 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:43.862418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 173/335] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:43.868326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf152-c8d7-49a7-a69a-dfc16a813ff0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:43.869276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf152-c8d7-49a7-a69a-dfc16a813ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:43.869736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cf152-c8d7-49a7-a69a-dfc16a813ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:43.897877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-719cf152-c8d7-49a7-a69a-dfc16a813ff0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:43.899504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-719cf152-c8d7-49a7-a69a-dfc16a813ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:43.999753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 163/336] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:44.208451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c6b0-779d-4371-a82d-f37a879fb12a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:44.208859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c6b0-779d-4371-a82d-f37a879fb12a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:44.209060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199c6b0-779d-4371-a82d-f37a879fb12a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:44.210834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 174/337] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:44.216087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a7d5-7e33-4340-b6d8-e31f1d348384 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:44.216675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a7d5-7e33-4340-b6d8-e31f1d348384 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:44.217166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a7d5-7e33-4340-b6d8-e31f1d348384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:44.245796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d214a7d5-7e33-4340-b6d8-e31f1d348384 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:44.247334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d214a7d5-7e33-4340-b6d8-e31f1d348384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:44.335341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 164/338] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:44.527037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1af4-a6d4-45b6-817d-324db9c54cba None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:44.527726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1af4-a6d4-45b6-817d-324db9c54cba None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:44.528216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1af4-a6d4-45b6-817d-324db9c54cba None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:44.530337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 175/339] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:44.538585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:44.539216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:44.539683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:44.563986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:44.565557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:44.590552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1af4-a6d4-45b6-817d-324db9c54cba None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:44.669445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:44.703381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 165/340] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:44.779223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:44.816235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1af4-a6d4-45b6-817d-324db9c54cba None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:44.861304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:44.862074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:44.862447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:44.862798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:44.885751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:44.890633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:44.891555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:44.892486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 176/341] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:44.899923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.054355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbbc6c-5c8c-411c-8009-201785e7edc1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.074270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.112143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.112693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.112995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.113265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.113968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:45.114269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:45.116529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:45.127688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 166/342] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:45.137778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.231095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:45.304010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c4b23-02a8-4003-9192-6645dfe1c6c3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.350844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bab967-57b4-4eb1-9027-59bf52548aa5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.360338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.361407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.361890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.363832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.382735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:45.390446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.391417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d26732bb-ce92-47df-9081-70d38c2b4979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:45.391643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:45.392703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:45.393759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:45.394424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 177/343] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:45.394759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.395166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.399425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4d5d-a828-4a83-8a2d-5e6aa83e68ee None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.399425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4d5d-a828-4a83-8a2d-5e6aa83e68ee None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.399425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4d5d-a828-4a83-8a2d-5e6aa83e68ee None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.399425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 178/344] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:45.400500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e4d5d-a828-4a83-8a2d-5e6aa83e68ee None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.409982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:45.484249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:45.486048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:45.538275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:45.563036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e4d5d-a828-4a83-8a2d-5e6aa83e68ee None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.595839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 167/345] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:45.596980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.609798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.610791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.611153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.611413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.631554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-45e4159d-841d-41e4-81bd-ffa24967e03c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:45.642132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:45.643345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:45.644395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 179/346] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:45.645582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.645972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.646399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.687052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:45.688903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:45.712819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3845d82-68ff-48b9-9daf-4460d2d826b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.751505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.752192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.752468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.752737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.753441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:45.753916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:45.755362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:45.765252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 168/347] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:45.766704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.774918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:45.782311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:45.792325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 180/348] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:45.794260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.882903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2f8e6-a397-404b-902d-2b9107a22eca None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:45.925656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:45.927061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:45.927725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:45.928172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:45.929602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:45.931205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:45.933368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 169/349] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:45.934400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:45.960075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9616b-6c90-45f8-bf07-caa60e519ba1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.017715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.018730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.019342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.019901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.021164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:46.021878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.022721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.028406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.043331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 181/350] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:46.044908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:46.047445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91b75-1926-40f4-8c5f-51e976e08d98 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.087118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.087745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.088184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.088596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.141804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.166277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.168015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0950781-6b7f-4dbf-b22d-6b39289edec6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.201616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b66f-4775-41fa-b0a1-48f08086ae77 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.249669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.250502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.250940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.251372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.260231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.261755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c532be-23bb-44fe-9838-42e45de01a15 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.263736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 182/351] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:46.264560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.264859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094450-1d90-4f72-a70b-764ca18949e2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.265892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094450-1d90-4f72-a70b-764ca18949e2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.265892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc094450-1d90-4f72-a70b-764ca18949e2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.267470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 183/352] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:46.268092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc094450-1d90-4f72-a70b-764ca18949e2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:46.300609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 170/353] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:46.301952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29348b5-cda9-4bb3-8b67-3585dc705771 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.302231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29348b5-cda9-4bb3-8b67-3585dc705771 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.302498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29348b5-cda9-4bb3-8b67-3585dc705771 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.303960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 171/354] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:46.307374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29348b5-cda9-4bb3-8b67-3585dc705771 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:46.428728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc094450-1d90-4f72-a70b-764ca18949e2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.442567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29348b5-cda9-4bb3-8b67-3585dc705771 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.457599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.478375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.479107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.479385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.479654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.495091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.496102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.497027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.497444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.518440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7a36b22c-462e-4039-b9d3-eb730fad39f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:46.525138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:46.526142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:46.526966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 172/355] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:46.530116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.530359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.532203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.554999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:46.556211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:46.587444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.589387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.607772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.668515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 173/356] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:46.668931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:46.748606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 184/357] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:46.748606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:46.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.813786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd4fbe-146c-486c-978b-ed87dc3d6bdc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.869737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.870354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.870624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.870884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.871627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3175ea486f38486eb4fb3cef53728d7e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:46.871935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.873727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9a684-e45d-4837-995c-24d8e33f3f39 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.881137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 174/358] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=801153a9ae764c76a1e10058e403d371 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:46.882165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.882450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.882960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.914015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:46.916526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:46.925627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e025e8-5b95-4b26-acba-d46640eff82a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:46.963481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:46.980966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:46.981758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:46.981900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:46.982168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:46.983439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:46.985152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:46.987228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 185/359] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:46.987774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.023901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 175/360] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:47.024637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.120387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:47.137465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362ddf-db19-4ff8-a277-d461204fd6b9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.188813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.190440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.190961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.191433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.192470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:47.193643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.195325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.211463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 186/361] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.212877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.220160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d2b0-bda2-4bcf-8e3e-44ed65729354 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.265653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.267387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.267387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.267387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.269368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.270823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.272693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 176/362] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.278585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.312799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:47.355782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e42ed-f1c8-4f48-a24b-d9402387dc49 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.393606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175ba5-05a3-440a-95de-49a74746d2b0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.401959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.403307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.403901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.404611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.421797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:47.428020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:47.429459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:47.430742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:47.432810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 187/363] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:47.433833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.454191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:47.461113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.461913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.462186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.462478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.464558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.466096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.467839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 177/364] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.469454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.602824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc9662-6517-4aeb-ba42-f12c25a2d1f8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.616438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:47.620567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330e65-769a-4e9a-9276-56b78a640282 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.654165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.655909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.655909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.655909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] PATH_INFO: `/v3/users/b7b9c1be71364e99b4088fd3eea934ea` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.657511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7b9c1be71364e99b4088fd3eea934ea)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.659960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.663403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 188/365] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/users/b7b9c1be71364e99b4088fd3eea934ea => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.664856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.678731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.679741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.681180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.681682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.684904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.686368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.690805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 178/366] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.690805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.803625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:47.831451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd89258-e10d-443d-a87b-123320fe7248 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.839402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a166-305a-40d0-a2c2-adbb81bbaee8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:47.884727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.885345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.885645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.885914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.886619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:47.886921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:47.888374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:47.897557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:47.898433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:47.898873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:47.899343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:47.900042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 179/367] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:47.901116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.927520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:47.936331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:47.938291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 189/368] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:47.939342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:47.943844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:48.063366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502285-b2b7-4fb1-bf8d-0867b092e0da None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.097834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6444c-0d8a-40fb-872c-3cb64dc64243 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.104027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.104662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.104964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.105237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.105985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=92293530e9464e0ea6885885e170633e, scope.project.id=3175ea486f38486eb4fb3cef53728d7e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:48.106289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.107754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:48.120930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 180/369] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=92293530e9464e0ea6885885e170633e => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:48.122252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:48.186472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.187966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.187966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.187966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.190014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] RBAC: Adding query filter params (role.id=cd7e0d936ded430b9c1ec6a84e00beaf, user.id=b7b9c1be71364e99b4088fd3eea934ea, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:48.190014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.190014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:48.199952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:48.224913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 190/370] 10.222.0.61 () {56 vars in 1308 bytes} [Mon Aug 29 19:59:47 2022] GET /identity/v3/role_assignments?user.id=b7b9c1be71364e99b4088fd3eea934ea&scope.system=all&role.id=cd7e0d936ded430b9c1ec6a84e00beaf => generated 510 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:48.226090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:48.339772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:48.352670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ba356-cfb1-4eaf-946e-8fb7c6921b64 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.399827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.401381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.401896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.402381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.403413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=e42a981507104542b4627863dab41780) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:48.403925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.405881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:48.413049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 181/371] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:48 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=e42a981507104542b4627863dab41780&role.id=801153a9ae764c76a1e10058e403d371 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:48.414291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:48.559185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28711e4-c3f0-442a-aeae-4ba3600905c3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.583077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f58db-d69d-40e1-8b73-44c8932ed0d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.631183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.632873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.633656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.634537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.636058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:48.636903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.639800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:48.658766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 182/372] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:48.665748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:48.677825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.678485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.678768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.679043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.701151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:48.800258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:48.801108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55590-91d5-4daa-894f-173d143bf855 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:48.813415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.815202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:48.850397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:48.851907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:48.852808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:48.853513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:48.952116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:48.954971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:49.013177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:49.067788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 191/373] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:49.074344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.091152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 183/374] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:49.101452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.239288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c9ea9-e3d4-49cb-a276-abd40c0ae6c9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:49.260113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:49.283876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:49.285298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.286074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.286732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] PATH_INFO: `/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.288410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] RBAC: Authorizing `identity:get_project(project_id=f12e64257ff84ab8bb7ebdf7133980d9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:49.290372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6cce2-fade-48c0-9e9d-6ff8a36a2f67 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:49.292860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 184/375] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:49.294691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:49.296857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d3a7-2b26-4add-86cc-34fc4755e22c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.297374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d3a7-2b26-4add-86cc-34fc4755e22c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.297925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731d3a7-2b26-4add-86cc-34fc4755e22c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.301847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 185/376] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:49.311008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.311279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.311690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.314349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fda46-b01b-4b01-a47d-d2d8db09dc3a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:49.337672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:49.339563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:49.365549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:49.366509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.366896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.367269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.370116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:49.372690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:49.376955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 192/377] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:49.378357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.442204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 186/378] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:49.443096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.583404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0abfb-2194-4244-9465-0a8db0fca5b2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:49.609144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2b2bf-78e3-4a5a-904b-ee47f26e76b6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:49.618077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:49.641277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:49.642076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.642423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.642762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.644567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:49.646273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:49.648545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 187/379] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:49.658929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.677271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:49.678454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:49.678730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:49.679853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] PATH_INFO: `/v3/groups/a35a62b35f13482aac29bbc43ac93267` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:49.693580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] RBAC: Authorizing `identity:get_group(group_id=a35a62b35f13482aac29bbc43ac93267)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:49.695068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:49.697068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 193/380] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/groups/a35a62b35f13482aac29bbc43ac93267 => generated 229 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:49.705602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:49.784312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:49.948141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611cef-d8bd-4d8e-992b-36a6e5d5d152 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:49.971081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5ab2-7d0d-42fd-8a68-3eb7a6498e4c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:50.012943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:50.013891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.014357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.014782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.020773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=92293530e9464e0ea6885885e170633e, scope.project.id=e42a981507104542b4627863dab41780) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:50.020773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:50.020773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:50.032784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 188/381] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=e42a981507104542b4627863dab41780&role.id=92293530e9464e0ea6885885e170633e => generated 260 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:50.037969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:50.068443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:50.072784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.072784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.072784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.072784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] RBAC: Adding query filter params (group.id=a35a62b35f13482aac29bbc43ac93267, role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=f12e64257ff84ab8bb7ebdf7133980d9) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:50.072784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:50.080809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:50.099166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 194/382] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:49 2022] GET /identity/v3/role_assignments?group.id=a35a62b35f13482aac29bbc43ac93267&scope.project.id=f12e64257ff84ab8bb7ebdf7133980d9&role.id=911a5bcd4e504f538aeb3869289f542b => generated 260 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:50.235508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:50.364775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd327b54-5590-4018-a7f8-d19e3a30ad45 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:50.439355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:50.440021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.440294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.440560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.463820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:50.469677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:50.471198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:50.472004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 189/383] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:50.477204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:50.646848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:50.689445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ea69-a963-481f-b6b1-481e3557b970 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:50.754244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:50.754866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.755130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.755397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.756070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:50.756429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:50.757847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d36e42-b6b6-45e3-9b44-57a03d662c11 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:50.770243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 195/384] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:50.776244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:50.872827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbe43-3849-46fe-8d04-336cf1511181 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.873641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbe43-3849-46fe-8d04-336cf1511181 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.874246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bbe43-3849-46fe-8d04-336cf1511181 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.881631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 196/385] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:50.883951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:50.884430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:50.884929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:50.921254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:50.922398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:51.009034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e237bb-d1c9-4c1d-a44d-38f034f5fd78 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:51.022516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:51.064429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:51.065480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.065908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.066391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.071032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:51.075187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:51.088443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 190/386] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:50 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:51.090354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 197/387] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:51.090922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:51.226607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c7307-bbf9-4cfc-8a6b-3a5584d6e4cf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:51.266082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:51.266988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.267313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.267584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.268866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:51.270312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:51.272371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 191/388] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:51 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:51.278270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:51.436191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:51.462577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38ad1-f20b-4198-8d43-2929547edf9b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:51.503577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:51.517260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:51.518114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.518406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.518764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.521030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, group_id=fd2c99a2314143d7b3d1290df2a83d6f, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:51.522743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843bbf-2c28-4e8f-8295-3c96b735e4b9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:51.543828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 198/389] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Aug 29 19:59:51 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:51.597141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:51.601437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be5c-3eeb-41fa-9d7b-3a6cabee04c0 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.602017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be5c-3eeb-41fa-9d7b-3a6cabee04c0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.602379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816be5c-3eeb-41fa-9d7b-3a6cabee04c0 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.604508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 199/390] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:51.614283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f96f00-0de6-4463-8359-986778d09293 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.614585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f96f00-0de6-4463-8359-986778d09293 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.614892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f96f00-0de6-4463-8359-986778d09293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.640643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-82f96f00-0de6-4463-8359-986778d09293 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:51.642169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-82f96f00-0de6-4463-8359-986778d09293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:51.714687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afea5-6f27-47a5-8a47-41a62add7a7f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:51.767513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 200/391] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:51.785508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:51.786264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.786531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.786801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.800424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:51.806630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:51.808350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:51.810290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 192/392] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:51.814749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f96f00-0de6-4463-8359-986778d09293 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:51.902430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:51.931203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f96f00-0de6-4463-8359-986778d09293 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:51.970778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:51.971396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:51.971674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:51.971946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:51.972620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:51.972956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:51.974543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:51.984246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 201/393] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:51.989879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.107972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.111307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a02f-9748-4b54-bfa8-9de967e658d4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.114981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:52.155504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.156690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.157128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.157616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.159062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:52.161427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:52.164259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 193/394] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:51 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:52.174305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.249991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ac62-2d8b-4ed1-8596-397876f9e3a9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.287573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.288595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.289088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.289550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.292673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:52.303413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:52.316768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:52.317747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:52.318543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:52.325281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 202/395] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:52.334113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.365971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805be513-55a4-4f46-a5b6-40295bd2ec49 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.414513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.415563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.416026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.416545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.418145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:52.420062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:52.422590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 194/396] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:52 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:52.430638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.477957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fa1ed-f232-4792-b7be-bf3788e41f27 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.537729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.538712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.539154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.539597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.540662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:52.541156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:52.543106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:52.556002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 203/397] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:52.565376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.569190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:52.673464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:52.732965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975ecca-ff4e-4036-a39a-6d8ddef46c9b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.746919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb964335-382d-4f51-aa5c-8e5ace822a25 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:52.793423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.794068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.794347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.794613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.795753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:52.797288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:52.799202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 204/398] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:52 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:52.804625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:52.812686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:52.813207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.813534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.813799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.816252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] RBAC: Authorizing `identity:create_grant(project_id=3175ea486f38486eb4fb3cef53728d7e, group_id=fd2c99a2314143d7b3d1290df2a83d6f, role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:52.818384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af285e-4e71-4aa8-9cb5-e00fee47e449 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:52.833932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 195/399] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Aug 29 19:59:52 2022] PUT /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/92293530e9464e0ea6885885e170633e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:52.969228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea041-646f-4e72-baf7-6595278241b2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.969228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea041-646f-4e72-baf7-6595278241b2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.969506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea041-646f-4e72-baf7-6595278241b2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:52.971310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 196/400] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:52.976957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191429-386d-421a-b326-61979af372ce None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:52.977186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191429-386d-421a-b326-61979af372ce None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:52.977506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191429-386d-421a-b326-61979af372ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.009981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c54ba-6bee-4966-aadc-2ad36f8e5613 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:53.014792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e0191429-386d-421a-b326-61979af372ce None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:53.016575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0191429-386d-421a-b326-61979af372ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:53.061148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:53.073446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:53.074420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:53.074789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:53.075242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.077542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:53.082791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:53.087624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 205/401] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:52 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:53.098269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:53.152790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 197/402] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:53.207053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885634-ef5d-46af-b4d5-85a5fd88531a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:53.207300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885634-ef5d-46af-b4d5-85a5fd88531a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:53.207550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885634-ef5d-46af-b4d5-85a5fd88531a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.209442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 198/403] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:53.232954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:53.233296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:53.233814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.264349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea7ecd-762a-4110-8b02-0ddddbaf57a4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:53.292364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:53.294900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:53.321862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:53.323570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:53.324057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:53.324520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.326879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, group_id=fd2c99a2314143d7b3d1290df2a83d6f, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:53.329657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:53.368911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 206/404] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Aug 29 19:59:53 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:53.373676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:53.451371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 199/405] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:53.610605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:53.708580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:53.778005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f08-851d-4765-b233-83f1f32c896d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:53.828289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:53.829328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:53.829836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:53.830300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:53.853851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:53.859878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:53.860911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:53.861771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:53.864347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 207/406] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:53.869528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:53.870480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.043837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354b0b-4523-48a7-8869-913eb6d63a8f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.049839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175a607-9623-4ece-be75-8f7cb1b14ff5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.093476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.113682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.114252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.114530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.114793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.120543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.121251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.121529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.121800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.122493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:54.123095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.125830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.143056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 208/407] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:54.143665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:54.148634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:54.150960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:54.151993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:54.152807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:54.155011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 200/408] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:54.168288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.198274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.386008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdf08-2c17-453f-a76d-910d3cb868c5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.404296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88aecb-3016-4245-bde7-9590ce70927b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.425880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.427180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.427603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.428009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.429109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:54.429549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.431849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189164b-a8a7-4990-8df0-1394f55e4e7f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.443198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 201/409] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:54.445024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba62542-6319-461d-ac8c-819b41f5bbde None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.445501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba62542-6319-461d-ac8c-819b41f5bbde None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.445959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba62542-6319-461d-ac8c-819b41f5bbde None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.447424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 202/410] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:54.455568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.456143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.456623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.469580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.470637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.471072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.471491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.474167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.477028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.479003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:54.480276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 209/411] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:54.480649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:54.481781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.539874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.581157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 203/412] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:54.582207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.605583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cbaa3-4a9f-46b5-a025-2a7bc5d2d274 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.615431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.644923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.646278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.646841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.647305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] PATH_INFO: `/v3/groups/a35a62b35f13482aac29bbc43ac93267` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.655048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] RBAC: Authorizing `identity:get_group(group_id=a35a62b35f13482aac29bbc43ac93267)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.664324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.669590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 210/413] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/groups/a35a62b35f13482aac29bbc43ac93267 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:54.677756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.770310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a20bf-b6f9-4f21-9039-cce1bbe01b8b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.816201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.817412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.817909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.818608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.820547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.822272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.825251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 204/414] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:54.834333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:54.933329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43956b7-abe9-4070-8b28-55b7eaad2b4a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:54.960241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.981574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:54.991249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:54.992253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:54.992776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:54.993241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] PATH_INFO: `/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:54.994629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] RBAC: Authorizing `identity:get_project(project_id=f12e64257ff84ab8bb7ebdf7133980d9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:54.996300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:54.998964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 211/415] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9 => generated 344 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:54.999812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:55.006197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f7a36-fc89-4382-9fd2-9f43bc7724df None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:55.057703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:55.059086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.059552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.060035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.063375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] RBAC: Authorizing `identity:create_grant(project_id=e42a981507104542b4627863dab41780, group_id=fd2c99a2314143d7b3d1290df2a83d6f, role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:55.066077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:55.085331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 205/416] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Aug 29 19:59:54 2022] PUT /identity/v3/projects/e42a981507104542b4627863dab41780/groups/fd2c99a2314143d7b3d1290df2a83d6f/roles/92293530e9464e0ea6885885e170633e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:59:55.086445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:55.134158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70edf3-d102-4b23-b346-8ea22f4915cf None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:55.203531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:55.204201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.204549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.204892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.214420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69239a-32d7-49f7-b682-f5cf1580e744 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:55.223226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:55.239462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:55.240437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:55.241420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 212/417] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:55.248510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:55.268400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:55.269481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.269961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.270813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] PATH_INFO: `/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9/groups/a35a62b35f13482aac29bbc43ac93267/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.276064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] RBAC: Authorizing `identity:create_grant(project_id=f12e64257ff84ab8bb7ebdf7133980d9, group_id=a35a62b35f13482aac29bbc43ac93267, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:55.278738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:55.296360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:55.307955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 206/418] 10.222.0.61 () {58 vars in 1442 bytes} [Mon Aug 29 19:59:55 2022] PUT /identity/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9/groups/a35a62b35f13482aac29bbc43ac93267/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:59:55.353846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:55.446333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f057-411c-48c4-82b2-9c60b01feef3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:55.499348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:55.499931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.500211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.500490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.502686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:55.502686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:55.502992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0188-2839-405f-9625-5b13702ff4fd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:55.515165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 213/419] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:55.520639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:55.575834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3807-e196-4f59-bf56-e727b9056aa7 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.576206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3807-e196-4f59-bf56-e727b9056aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.576568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e3807-e196-4f59-bf56-e727b9056aa7 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.578431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 214/420] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:55.584333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.585045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.585672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.611028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:55.613073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:55.646635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7abd6b-cce3-42fb-9590-89464a38d947 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:55.702339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:55.704253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:55.704526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:55.704812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:55.706834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 215/421] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:55.784966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:55.793560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:55.795108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:55.935829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 207/422] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:55.942065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:55.987906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.021349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.081059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc19f18-3f7f-4114-a735-e8a907f330b4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.125327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.126020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.126301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.126572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.128001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:56.129746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111e913-6356-4d31-ac24-f496db2a04fb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:56.131960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 216/423] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:55 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:56.137481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818876-5a5a-4d9f-a268-391e2fb26238 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.137762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818876-5a5a-4d9f-a268-391e2fb26238 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.138038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818876-5a5a-4d9f-a268-391e2fb26238 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.139837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 217/424] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:56.141653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818876-5a5a-4d9f-a268-391e2fb26238 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.175750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.180236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253d19-5b80-41e4-8e4f-6da07a7a2eb5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.220053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.220982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.221479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.221971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.233631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6216d24c-ee4a-4e18-be3a-39e9d35d0a04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:56.239539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:56.240427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:56.241296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:56.243707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 208/425] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:56.245357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.245875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.246341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.270163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:56.271351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.272459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:56.276123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818876-5a5a-4d9f-a268-391e2fb26238 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.320628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.321334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.321596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.321864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.323362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:56.325140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:56.328832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 218/426] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:56.330016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.365649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 209/427] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:56.366295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.451193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7824d-6cde-4369-9567-4658bfa2b101 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.474932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.485589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d8c9-cd63-4861-99e4-810df3d670f4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.495659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.496806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.497377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.498151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.499519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:56.500135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:56.502008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:56.512322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 219/428] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:56.519446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.524558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.525259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.525498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.525770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.527359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=3175ea486f38486eb4fb3cef53728d7e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:56.527359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:56.528357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:56.536822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 210/429] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=801153a9ae764c76a1e10058e403d371 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:56.583749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.675842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299800b-a118-4b6a-9802-e625cf4383dd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.712234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.712900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.713152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.713442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.754122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.788104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:56.789780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:56.822636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:56.881989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017d21b-d021-4bb9-8ac7-5313f462d284 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:56.905656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 220/430] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:59:56.913674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.932888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:56.933739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:56.934306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:56.934763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:56.952656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:56.959914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:56.960876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:56.961689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 211/431] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:59:56.967841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:56.996375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.055120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7baa52-7322-414a-9ea7-e45ba65e110d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.095865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.098359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ecc8-70c2-4cfb-8cab-947dffd8b5f1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.104846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.105693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.106115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.106525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] PATH_INFO: `/v3/projects/3175ea486f38486eb4fb3cef53728d7e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.108434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] RBAC: Authorizing `identity:get_project(project_id=3175ea486f38486eb4fb3cef53728d7e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.110714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.113596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 221/432] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/projects/3175ea486f38486eb4fb3cef53728d7e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:57.119157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.146799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.147436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.147705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.147975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.148648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:57.148982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.153863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.164653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 212/433] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 19:59:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:57.170196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.262484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.284372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e477f-8838-401e-8c9d-ffa91f4851e8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.291238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c853b-002a-4e8b-b591-ca814d4625de None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.328406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.328616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.328881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.329156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.335528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.336517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.337026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.337495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.338951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.340764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.348598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 222/434] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:57.350270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.406299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.407727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.434301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.490454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.491812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4e44-f94a-41d5-b15f-738ea8f065ae None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.519128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 213/435] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:57.524972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.541253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.542197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.542640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.543162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.544162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=92293530e9464e0ea6885885e170633e, scope.project.id=3175ea486f38486eb4fb3cef53728d7e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:57.545167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.547038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cbfe7-14f3-4cd4-8fbf-853838e9c4d6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.554788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 223/436] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=3175ea486f38486eb4fb3cef53728d7e&role.id=92293530e9464e0ea6885885e170633e => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:57.642281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717afc46-6bc0-4907-9b85-6f61ea21e307 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.649264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988f3d-e006-4d2d-92ed-aacc55551746 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.649942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988f3d-e006-4d2d-92ed-aacc55551746 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.650433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988f3d-e006-4d2d-92ed-aacc55551746 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.652391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 224/437] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:59:57.659687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446836c-8f40-45b1-b684-3d85da5c6d71 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.660344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446836c-8f40-45b1-b684-3d85da5c6d71 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.660873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446836c-8f40-45b1-b684-3d85da5c6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.685940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.685940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.685940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.685940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.686387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.688716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.689164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 214/438] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:59:57.695396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.696234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f446836c-8f40-45b1-b684-3d85da5c6d71 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:57.700180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f446836c-8f40-45b1-b684-3d85da5c6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:57.756108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:57.798361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 225/439] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:59:57.840269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac020250-05f5-4f55-90f7-637fc8e1966c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:57.865387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510539-4bab-48bd-aad2-fb602ffff200 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.865676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510539-4bab-48bd-aad2-fb602ffff200 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.866036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510539-4bab-48bd-aad2-fb602ffff200 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.867527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 226/440] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 19:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:59:57.872945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.873239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.873509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.886532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:57.887187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:57.887610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:57.888369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:57.890458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:57.893091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:57.893489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:59:57.894780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:59:57.895271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 215/441] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:57.900883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:57.976426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.000718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 227/442] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 19:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:59:58.079804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39594e16-e221-4b9a-99f7-bb85094ac03f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.089676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.105846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.143000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.143708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.144005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.144952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.145294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=801153a9ae764c76a1e10058e403d371, scope.project.id=e42a981507104542b4627863dab41780) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:58.145647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:58.147459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:58.157485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 216/443] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:57 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=e42a981507104542b4627863dab41780&role.id=801153a9ae764c76a1e10058e403d371 => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:58.240952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a4c0d-6fda-4d7c-aa2b-67d87c90b7aa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.270768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.291214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.291886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.292275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.292641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.308367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:58.314655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:58.315900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 19:59:58.316851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 228/444] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:58.323355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.402322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.414128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361b50-0e7a-4261-aaea-9630aeca1239 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.463220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.463877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.464161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.464436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.477762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:59:58.482967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac62c-5b2a-415f-b03e-1f5b78c88e8f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:59:58.483195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:59:58.484106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 19:59:58.484965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 217/445] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:59:58.493295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.536163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.536982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.537353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.537645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.538689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:58.538955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:58.539162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.541269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:58.552861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 229/446] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:58.558867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.637995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c95cb4-1152-4584-82e2-313adfdf7d5c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.679014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899761-43d2-4b5f-8682-eedfd1ecd3be None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.682946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.683826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.684208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.684585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.685553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:58.686066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:58.688821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:58.696578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.699854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 218/447] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:58.706160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.722677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.723308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.723653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.723880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.809599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:58.811238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:58.831615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.835715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e55d-d57a-4fe2-9f61-c96f0c2b5e54 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:58.878186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:58.878858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:58.879178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:58.879444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:58.930312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 230/448] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:58.936566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:58.957837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:58.967222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:58.969062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.055153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107d113-df7f-4ab3-aa3e-40a6f9536889 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.077847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:59.082826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 219/449] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:59:59.088739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:59.094547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.095185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.095456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.095726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] PATH_INFO: `/v3/projects/e42a981507104542b4627863dab41780` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.096928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] RBAC: Authorizing `identity:get_project(project_id=e42a981507104542b4627863dab41780)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.098393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.100029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 231/450] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:58 2022] GET /identity/v3/projects/e42a981507104542b4627863dab41780 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:59.105590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:59.196034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:59.201912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3747-3952-4487-b5d8-e4d7ad07e893 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.218109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034337c-77b9-4e34-85bb-0527831a1cac None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.242621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.243258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.243527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.243790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] PATH_INFO: `/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.245123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] RBAC: Authorizing `identity:get_project(project_id=f12e64257ff84ab8bb7ebdf7133980d9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.246668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.248628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 220/451] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 19:59:59 2022] GET /identity/v3/projects/f12e64257ff84ab8bb7ebdf7133980d9 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:59.255280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:59.262557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.263425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.263717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.263992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] PATH_INFO: `/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.265306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] RBAC: Authorizing `identity:get_group(group_id=fd2c99a2314143d7b3d1290df2a83d6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.268716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.270546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 232/452] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:59 2022] GET /identity/v3/groups/fd2c99a2314143d7b3d1290df2a83d6f => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:59.276981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:59.334932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:59.375853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369e99b-7fc8-4c6e-8a74-accb57805fff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.393750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7de32-8ab7-43fe-ab23-232c423175ae None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.413683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.414449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.414811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.415169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] PATH_INFO: `/v3/groups/a35a62b35f13482aac29bbc43ac93267` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.416652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] RBAC: Authorizing `identity:get_group(group_id=a35a62b35f13482aac29bbc43ac93267)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.418383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.420464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 221/453] 10.222.0.61 () {56 vars in 1180 bytes} [Mon Aug 29 19:59:59 2022] GET /identity/v3/groups/a35a62b35f13482aac29bbc43ac93267 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:59.426598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:59:59.429815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.430434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.430711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.430977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.431711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] RBAC: Adding query filter params (group.id=fd2c99a2314143d7b3d1290df2a83d6f, role.id=92293530e9464e0ea6885885e170633e, scope.project.id=e42a981507104542b4627863dab41780) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:59.432221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.434797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2ed9a-613d-4e60-9571-87d7e2d32f9c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.442982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 233/454] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:59 2022] GET /identity/v3/role_assignments?group.id=fd2c99a2314143d7b3d1290df2a83d6f&scope.project.id=e42a981507104542b4627863dab41780&role.id=92293530e9464e0ea6885885e170633e => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:59:59.551625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd330de0-8185-47e2-9523-77ccc7c9ce01 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:59:59.600451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:59:59.600451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:59:59.600883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:59:59.600959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:59:59.602339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] RBAC: Adding query filter params (group.id=a35a62b35f13482aac29bbc43ac93267, role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=f12e64257ff84ab8bb7ebdf7133980d9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:59:59.602339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:59:59.603380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ece5a-c872-4aa6-af2f-0c0299202928 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:59:59.605350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:59:59.612911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 222/455] 10.222.0.61 () {56 vars in 1376 bytes} [Mon Aug 29 19:59:59 2022] GET /identity/v3/role_assignments?group.id=a35a62b35f13482aac29bbc43ac93267&scope.project.id=f12e64257ff84ab8bb7ebdf7133980d9&role.id=911a5bcd4e504f538aeb3869289f542b => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:02.079082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0434ce-3e5b-4bea-a5dd-c30aa30f17d9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:02.079595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0434ce-3e5b-4bea-a5dd-c30aa30f17d9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:02.079595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0434ce-3e5b-4bea-a5dd-c30aa30f17d9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:02.081369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 234/456] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:02.088916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdf160-308e-4724-9ee1-aea141083c8f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:02.090299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdf160-308e-4724-9ee1-aea141083c8f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:02.091029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdf160-308e-4724-9ee1-aea141083c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:02.130001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6ffdf160-308e-4724-9ee1-aea141083c8f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:02.131444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ffdf160-308e-4724-9ee1-aea141083c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:02.248213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 223/457] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:00:02.669524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeba5e-0119-4e1d-a2ad-a361dc9f5426 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:02.669786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeba5e-0119-4e1d-a2ad-a361dc9f5426 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:02.670100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeba5e-0119-4e1d-a2ad-a361dc9f5426 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:02.672184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 235/458] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:02.678040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:02.678040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:02.678332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:02.708794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:02.708983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeba5e-0119-4e1d-a2ad-a361dc9f5426 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:02.710456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:02.728612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:02.844820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeba5e-0119-4e1d-a2ad-a361dc9f5426 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:02.870368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 224/459] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:02.901410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:02.902440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:02.902931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:02.903392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:02.920572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:02.922758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b00295c9-d6b8-441a-8269-1e97a7f03c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:02.951221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:02.952418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:02.953347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:02.953347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:02.953347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:02.955206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 236/460] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:02.961296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.022677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baba03-baf5-415c-a1a9-3c2ca6e38b30 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.023367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baba03-baf5-415c-a1a9-3c2ca6e38b30 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.023896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baba03-baf5-415c-a1a9-3c2ca6e38b30 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.027256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 237/461] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:03.037140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.042716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.043359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.043850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.065144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:03.066789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:03.129332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ee45a-fd4e-4521-a938-6f533de5e7b4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.151135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.170018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 238/462] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:00:03.191960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.193067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.193555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.194064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.194940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:03.195476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.197119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a4fef-7d0a-4fd6-9007-219e0c93de74 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:03.210764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 225/463] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:03.218094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.339290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4998786-d663-4cc7-947f-7558ed275e6e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.361660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62814-acdd-4663-a043-4222847ce564 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.362265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62814-acdd-4663-a043-4222847ce564 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.362724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62814-acdd-4663-a043-4222847ce564 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.365500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 226/464] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:03.366633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62814-acdd-4663-a043-4222847ce564 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.383484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.384265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.384551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.384931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.385989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.387764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4ac72-4b21-48f0-90cc-84450006dcb9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:03.416202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 239/465] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:03 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:03.417604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.417890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.418157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.456672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:03.458559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:03.538741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62814-acdd-4663-a043-4222847ce564 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.553690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.567720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.586006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 240/466] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:03.586683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.590449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.590654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.590924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.591190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.606247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.608161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:03.627023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:03.628204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:03.629289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:03.629289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:03.629289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:03.630793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 227/467] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:03.637679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.702847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317f58-65dd-47eb-8171-e897db5722e7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.743404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.744084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.744360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.744625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.756912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.758375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:03.774121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:03.775095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:03.775969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:03.775969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:03.775969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:03.775969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 241/468] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:03.787026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.828326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.833770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c8439-a424-480e-b3da-a0d359055f54 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.904468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.905300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.905545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.905804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.908297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:03.908602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.910029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:03.937892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 228/469] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:03.940908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b786e75-60f6-47dd-b069-df77f59bff45 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:03.942434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:03.979831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:03.992249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:03.993924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:03.994144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:03.994413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:03.995139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:03.995439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:03.998048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.015812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 242/470] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:04.017007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:04.059281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcb1e-b4cd-4cb2-9d12-fa08728fc4c5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.096489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.097132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.097411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.097662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.098308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.099717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.123963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 229/471] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:03 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:00:04.124530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:04.148333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:04.163310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7495d0-c81b-4ba5-ae2a-c0055f38a7c9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.220966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.222734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.223255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.223960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.226590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:04.243657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.246325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.247274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4010f49-c4bb-45df-8093-cecb19ad0e64 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c41a1864-0ca9-4c50-b732-eb67470d469a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:04.268685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:04.269666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:04.270502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:04.270502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:04.270502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:04.271403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 243/472] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:04.272628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47dbc2-6f5f-457d-b51b-1ab9f3774c17 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.272971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47dbc2-6f5f-457d-b51b-1ab9f3774c17 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.273223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47dbc2-6f5f-457d-b51b-1ab9f3774c17 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.274589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 244/473] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:04.279686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.280028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.280302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.300386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.302125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.302125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.302125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.302371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.303482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:04.303665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.304687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:04.330721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 230/474] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:04 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:04.331569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:04.387846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 245/475] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:04.463192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcc18-33c6-4b04-bce5-0883ad1c4b73 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.501970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.502928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.503412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.503875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.504781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:04.505290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.506871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.521545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 231/476] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:04.527101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:04.613262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:04.642419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75ad7d-56c4-4c9e-98e6-402bab1ac932 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.689099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.689738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.690014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.690285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.690945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.692390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.710156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:04.714501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:04.734216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 246/477] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:04 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:00:04.850744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf89b-f035-45c9-9f1e-a25fd11f0214 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:04.887341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:04.888013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:04.888289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:04.888550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:04.889360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:04.891420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:04.901838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.sql.core [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:00:04.901838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:00:04.901838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [parameters: {'id': 'e9090d8d3b5c48fcaab72be62d6e6730', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:00:04.901838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81695) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Aug 29 20:00:04.920159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:00:04.921749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application yield resource Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise self.value Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application session.commit() Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:00:04.922663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:00:04.924058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:00:04.925819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:00:04.927531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [parameters: {'id': 'e9090d8d3b5c48fcaab72be62d6e6730', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:04.929216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 20:00:04.930705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:04.932595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 232/478] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Aug 29 20:00:04 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:04.932739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:05.041604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be46ce-e6cf-4d98-90fc-99522b03ac63 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:05.072278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:05.081827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:05.082524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:05.082837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:05.083117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:05.094754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b52961e1-bf6b-4efe-919b-c61f34c11cb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:05.102159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:05.104241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:05.106262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 247/479] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:05.112585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:05.197264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:05.231605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f92d-7896-4fb5-bb68-f7ee3deb87eb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:05.269275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:05.269892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:05.270162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:05.270425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:05.271089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:05.271378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:05.272740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1412fbe-a3fd-45d2-978c-f03d706d4eb7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:05.282009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 233/480] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:05.881345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2eb26-943a-4813-910f-fcc658b49cb8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:05.881345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2eb26-943a-4813-910f-fcc658b49cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:05.881345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2eb26-943a-4813-910f-fcc658b49cb8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:05.882615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 248/481] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:05.892004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79259-32ef-465f-9514-3fde8f57f0ec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:05.892004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79259-32ef-465f-9514-3fde8f57f0ec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:05.892004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79259-32ef-465f-9514-3fde8f57f0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:05.913262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9ef79259-32ef-465f-9514-3fde8f57f0ec None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:05.914881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9ef79259-32ef-465f-9514-3fde8f57f0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:06.026528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 234/482] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:06.448208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2eb26-943a-4813-910f-fcc658b49cb8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:06.590922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2eb26-943a-4813-910f-fcc658b49cb8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:06.611050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97557-442d-4009-a53a-50372397d6c9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.612020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97557-442d-4009-a53a-50372397d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.612534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97557-442d-4009-a53a-50372397d6c9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:06.614495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 235/483] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:06.620121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.620725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.621299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:06.653043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:06.654212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.654509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.655072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:06.675848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:06.675848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:06.687332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:06.698333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:06.699263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:06.700135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:06.709299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 249/484] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:06.717955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:06.798760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:06.821175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:06.867310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0f4a-1e0d-43a1-b9a7-a623cae0f036 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:06.879289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 236/485] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:06.908573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:06.909348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.909603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.909910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:06.910633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:06.910934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:06.912478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff05077-f7cc-481e-a90c-a873647ce195 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:06.924880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 250/486] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:06.931608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:06.989074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4113c9b-09dc-43ab-ab5a-bd6ab666d9f9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.989663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4113c9b-09dc-43ab-ab5a-bd6ab666d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.990147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4113c9b-09dc-43ab-ab5a-bd6ab666d9f9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:06.992059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 251/487] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:06.998122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:06.998728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:06.999209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.027172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:07.028495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:07.151614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6aafd-4aa3-4e72-98eb-b6098fc5eff6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.174745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 252/488] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:00:07.208496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.209186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.209461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.209727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.222434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:07.224338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:07.229844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:07.265748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:07.266672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:07.267555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:07.267555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:07.267555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:07.267555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 237/489] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:07.274304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.322471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:07.366850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:07.417239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b80a5-6377-49c0-9c1d-24771d196c91 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.461115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.461828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.462101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.462367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.474608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:07.479691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:07.480835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:07.481806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:07.484227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 253/490] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:07.488773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce17a0-9cdd-4957-ac04-b039bda96b05 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.490631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.567704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.568536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.568922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.569213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.570346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:07.570735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:07.572697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:07.596764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 238/491] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:07.598170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.621620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2315-b1ed-4882-bc4b-b77fe4d0cf0b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.624255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:07.663656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.664558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.664867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.665129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.665850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:07.666094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:07.667472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:07.679557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 254/492] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:07.680519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.727572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:07.732301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64aa04-77f9-4197-bea8-eb0b3fe53c8b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.784238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.785723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.786210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.786947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.804621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b5de3991-264f-43d3-b9e0-9eff6664a711 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:07.813196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:07.814290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:07.815137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:07.816352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 239/493] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:07.817958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea1e5-e444-4322-83dd-070d518efc0c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.817958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea1e5-e444-4322-83dd-070d518efc0c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.818220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea1e5-e444-4322-83dd-070d518efc0c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.819428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 240/494] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:07.820115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fea1e5-e444-4322-83dd-070d518efc0c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.839368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304aa88-69db-4ea7-a80d-a331eca8ec27 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.888506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.889286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.890222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.890610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:07.898746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:07.900227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:07.914777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:07.916162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 255/495] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:07.917145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:07.946733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:07.956953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fea1e5-e444-4322-83dd-070d518efc0c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:07.996902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:07.997852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:07.998126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:07.998416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.011197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.012659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-af4e729a-9179-4b37-8eac-c5f07e3b2d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:08.027830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:08.029032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:08.030374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:08.030374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:08.030374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:08.030374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 241/496] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:08.030620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3d55-0214-4fa7-b9c3-ddc6839f1d3d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.030780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3d55-0214-4fa7-b9c3-ddc6839f1d3d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.031028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f3d55-0214-4fa7-b9c3-ddc6839f1d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.034599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e0eb-9cb6-4e19-a897-6cdbd9828809 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.048580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-375f3d55-0214-4fa7-b9c3-ddc6839f1d3d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:08.049819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-375f3d55-0214-4fa7-b9c3-ddc6839f1d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:08.057274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.070009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.070550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.070829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.071100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.071766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:08.072067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.073516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.081733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 256/497] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:08.082522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.121500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 242/498] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:08.123071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185b803-2ce7-41b5-9855-f11054b8b2c5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.123374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185b803-2ce7-41b5-9855-f11054b8b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.123767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185b803-2ce7-41b5-9855-f11054b8b2c5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.125150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 243/499] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:08.129918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185b803-2ce7-41b5-9855-f11054b8b2c5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.173578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.190754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed1c7-a240-44a9-bde6-cf06c8a301fa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.225750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.226361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.226637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.226906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.227635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:08.227937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.229400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.241927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185b803-2ce7-41b5-9855-f11054b8b2c5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.266838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 257/500] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:08.267674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.282445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.283365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.283892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.284361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.285210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:08.285684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.287442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bffc59-dcb3-4ba1-a34d-983eab9dd017 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.300405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 244/501] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:08.301898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.302319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.302725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.309466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.324463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:08.325731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:08.380059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28413c-0dca-44f5-87bb-85eb69d39d99 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.395887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 245/502] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:08.396774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.430017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.430704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.431003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.431299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.443686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.445210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.447777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:08.461641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:08.462601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:08.463478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:08.463478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:08.463478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:08.463478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 258/503] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:08.464325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.513095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d696e9-ea11-41e9-b46a-cb3a95842fae None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.544511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.551297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.551916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.552192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.552450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.582361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8969ba-24ec-4016-9616-58f1793a5fc9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.623502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.625142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.625294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.625564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.628267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.629756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.634291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.635885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:08.648408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:08.649389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:08.650278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 259/504] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:08.650854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.724048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.745274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 246/505] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:08.746154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.788120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167db0c4-9e2b-42ea-b823-15614ea62550 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.789947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:08.833043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.833603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.833875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.834141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.846449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:08.851829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:08.853003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:08.853974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:08.858007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 260/506] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:08.859047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.879006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e150-24f1-49ad-9daf-56c56cb97761 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:08.919464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:08.920081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:08.920470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:08.921416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:08.922118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:08.922420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:08.923804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:08.936841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 247/507] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:08.938086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:08.985555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c50f47-1440-481d-8dc2-1501d6caa4fe None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.004029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.027251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.027880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.028149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.028415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.029195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:09.029502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.031079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.053808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.057437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 261/508] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:09.058076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.068773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf19ba-04b7-416d-a1f9-a7146a803e70 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.111384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.112282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.112716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.113183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.129692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.132217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:09.148564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:09.149563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:09.150421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:09.150421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.150421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:09.150421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 248/509] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:09.150651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.193964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e983-e583-49ce-92b8-8ba483048a5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.228570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.229221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.229555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.229817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.241221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.242689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:09.257772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:09.258708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:09.259763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:09.259763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.259763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:09.259763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 262/510] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:09.259763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.270641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd76e-f3fd-477a-9870-2087b0c9965d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.290483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.304959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.305553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.305832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.306194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.307110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:09.307110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.308429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.324863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 249/511] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:09.325736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.335422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.375009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340525-c67d-47f2-8e26-3049bf42b694 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.410585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.411240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.411512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.411777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.419465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.420950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.429085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca02f59-995e-4fee-ad62-3a9f2ae62878 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:09.432019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:09.432982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 263/512] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:09.433896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.467246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.467871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.468152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.468419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.526867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.536520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.538009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.544590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb58aa-3ccb-44c1-a5ec-c044b6cbdb52 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.545787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.579404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.580022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.580290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.580561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.581227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:09.581526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.582934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.595991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 264/513] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:09.596842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.642508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 250/514] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:09.643698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.705613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739ed39-b7c5-48a6-a15f-c70d96011821 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.741961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.742568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.742847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.743115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.743761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:09.744063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.745466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.745567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c6b6-212f-4bb2-b5d3-085f2e82ae8d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.753985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.757737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 265/515] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:09.758537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.768422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:09.784929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.785564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.785852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.786102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.797575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.799023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:09.814784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:09.815769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:09.816638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:09.816638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:09.816638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:09.816638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 251/516] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:09.817099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.867556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be1bc7-9e27-4008-921f-cc5d7fe2276d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.905866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.906558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.906829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.907091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.907821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:09.908117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.909561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.921017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb158c-6964-4fae-bb60-423678d4de27 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:09.927067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 266/517] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:09.927880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:09.956424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:09.957038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:09.957294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:09.957557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:09.958192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:09.960310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:09.985386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 252/518] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:09 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:09.993870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.002473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.018798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.052351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915bed-4728-4e7d-897a-ef9a4305f04f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.089776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.090421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.090701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.090971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.103339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.104880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:10.127707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:10.128829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:10.129729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:10.129729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:10.129729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:10.129907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a036e-87cf-427b-84ab-7c1426240f30 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.133890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 267/519] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:10.134747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.173895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.174491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.174923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.175191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.183345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.184548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:10.202633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:10.204309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 253/520] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:10.206056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.277249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64767403-64a7-4688-bf22-5da61bb690f8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.298560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.301625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.324765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.325383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.325653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.325920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.326642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:10.327058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.328476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.336644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c086c-01a0-4857-94a7-451d0e6c3335 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.347274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 268/521] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:10.347274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.385318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.386204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.386479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.386796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.472729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.474248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.480422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0463-9ffc-49fd-8a6c-d63936fe51a6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.543151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.544119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.544583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.545471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.546380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:10.546890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.548673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.568285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 269/522] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:10.569161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.576227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.621478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 254/523] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:10.622697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.635893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.732006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8852c-e659-49c8-905c-75b8c18cd4e1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.769566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c126b-7694-4a42-aea2-36b3e6fd73fa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:10.780781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.781694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.781925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.782284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.783672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:10.784189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.785878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.812145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 270/524] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:10.812145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.819553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:10.820655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:10.821267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:10.821540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:10.830534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:10.831984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:10.851688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:10.853768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 255/525] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:10.855711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:10.907302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.986361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:10.996473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696255f-0171-4802-b440-5a4f1a6f1e68 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.019082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998525-2a15-4e85-9122-4c830366e8bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.048668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.049304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.049586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.049852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.062070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.065338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.073861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.074588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.074996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.075592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:11.084441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:11.085653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 271/526] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:11.087053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.097106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.098809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:11.128441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:11.129551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:11.130460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:11.130460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:11.130460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:11.130460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 256/527] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:11.131319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.222527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b0501-38c6-4744-a786-3e23ceb218ea None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.247799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:11.264585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802ec9-e982-4a42-b16f-501388a1e329 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.265628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.266259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.266788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.267059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.268880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:11.269199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.270786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.284796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 272/528] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:11.284796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.309407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.310224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.310897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.311502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.312708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:11.313331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.314875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.323864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:11.359056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 257/529] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:11.360015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.442572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0a561-2fc1-469b-b9b5-6bd84cfd07a4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.482446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.484218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.484604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.484935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.485653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:11.485959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.487442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.501915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 273/530] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:11.503000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.586889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da163890-9186-4205-8201-8ca4a09ae6e8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.595132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:11.617073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb8dcd-efba-42da-a53f-26dc506ce575 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.656470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.656470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.656470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.657063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.663888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.664863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.665302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.665761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.666726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:11.667167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.668827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.682874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 258/531] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:11.684022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.689030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:11.742376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.744982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.803696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e4807-13ed-4005-84a4-0c92e21848a2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:11.834261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:11.849109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:11.850793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:11.851466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:11.852125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:11.853973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=4fa74e5d2adb4da1afcecdb718be98f4) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:11.854682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:11.857548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:11.861220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 274/532] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:11.862255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.872948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 259/533] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/role_assignments?user.id=4fa74e5d2adb4da1afcecdb718be98f4&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:11.874344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:11.975671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6290f4-4125-44d8-af36-f4f1d4712ec1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.004665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.019441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.019441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.019441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.019441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.022475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.024469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:12.051120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:12.052686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:12.053831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:12.054270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 275/534] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:12.060332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbcb7-75e8-4655-a281-3e646b2d410b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.073859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.103073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.104021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.104553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.105005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.135179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.138833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.166365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-25f3a098-7276-47a9-bfc3-a8c7f5fc3265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:12.168924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:12.170069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:12.171364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:12.171364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:12.171364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:12.171364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 260/535] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:12.176507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679623e-29a5-4d83-997a-bb89237eed2e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.176507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679623e-29a5-4d83-997a-bb89237eed2e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.176507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679623e-29a5-4d83-997a-bb89237eed2e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.176507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 261/536] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:12.177680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679623e-29a5-4d83-997a-bb89237eed2e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.246324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fc97-d2aa-4334-85a2-c179eb500f0b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.289967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.290772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.291129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.291460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.292220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:12.292582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.294282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a4c0-186d-433b-95e3-d1bdc21297e5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.308848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 276/537] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:12.310034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.310370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.310885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.320787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679623e-29a5-4d83-997a-bb89237eed2e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.331528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:12.332937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:12.350133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.370376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.371202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.371537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.371864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.373207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:12.373740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.375303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.391461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 262/538] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:12.392421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.426360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 277/539] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:12.427374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.463614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.556882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83d39e-af38-4235-95c2-2ec1c4cee0d5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.600200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.600778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.601089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.601325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.609293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.611235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:12.625863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:12.626765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:12.627615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 278/540] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:12.636930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.637212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39cdf4-ddda-41e7-b676-509764aacd71 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.712525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.717539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.718077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.718487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.719440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=b756232a28874eba8520a100216a156a) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:12.719938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.721596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.734410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 263/541] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/role_assignments?user.id=b756232a28874eba8520a100216a156a&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:12.735556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.796858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.812871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:12.822498 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206bbe-b673-4d84-854b-e4ab466a831c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:12.907981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:12.910216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:12.912168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:12.912708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:12.913720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:12.914514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:12.917084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:12.941798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 279/542] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:12.951448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:12.953191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e33d74-1b52-4bc6-a3ce-7be95e738128 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:13.024662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:13.026068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.029286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.030030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.055386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:13.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:13.066974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:13.067773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:13.075367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 264/543] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:13.085909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:13.154050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545053f-bea7-4779-aea1-9ad8a432602d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:13.246192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:13.247369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.247825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.248330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.250906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=b25325b450fe4a14941600dd16c557fb) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:13.251181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:13.253812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:13.274960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 280/544] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:12 2022] GET /identity/v3/role_assignments?user.id=b25325b450fe4a14941600dd16c557fb&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:13.285826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e78ee-21d7-4514-b193-70ddd6f9bf93 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:13.294669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:13.374233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:13.375728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.376454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.377192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.378645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:13.379423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:13.382077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:13.399380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 265/545] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:13.409091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:13.445391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:13.544537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea560b-28ea-4cd3-af41-bad997a5cf1f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:13.596547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:13.597243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.597517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.597784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.609737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:13.611227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e47f9502-34f1-49ed-b41f-f12688964f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:13.633516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:13.634508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:13.635512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:13.635512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:13.635512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:13.635512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 281/546] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:13.643070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:13.819002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e21f7-a9fd-45a7-9545-ab51c45a274e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:13.842559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad865-b80b-4881-ada5-c21ab7c8cf9e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.843200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad865-b80b-4881-ada5-c21ab7c8cf9e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.843743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad865-b80b-4881-ada5-c21ab7c8cf9e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.845648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 282/547] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:13.851215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.851802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.852260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.860788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:13.860788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:13.860788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:13.860788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:13.861195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:13.861195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:13.861195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:13.876059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 266/548] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:13.881903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:13.901851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:13.903444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:13.914763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:14.003509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a97ae4-8239-458d-ab68-ddc432ddb277 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:14.048510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:14.049194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.049460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.050211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.060434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:14.062461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:14.076758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:14.077960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:14.078897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 267/549] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:14.083594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:14.106217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:14.142792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 283/550] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:14.208270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:14.225529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db389-4f83-48fa-a167-2caffbbb0666 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:14.262224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:14.263027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.263305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.263575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.264435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:14.265124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:14.266310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c09003-6a48-41fa-a6e1-77eab6994b1d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:14.286359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 268/551] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:14.292061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:14.336806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c0c0-9849-45c3-ae6c-b907e11bb285 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.337054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c0c0-9849-45c3-ae6c-b907e11bb285 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.339593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c0c0-9849-45c3-ae6c-b907e11bb285 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.339593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 269/552] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:00:14.344681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.345044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.345268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.365192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:14.366457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:14.460569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1aabc-e79f-4f24-afc9-7262ee4a9d8e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:14.501303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 270/553] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:14.518268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:14.519384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.519898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.520456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.548012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:14.634954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:14.651076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:14.653001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:14.668513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:14.737162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791ad31-aa6c-4122-ba2d-9eed1edf733a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:14.817349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:14.818003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.818273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.818540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.839438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5bb0ec7f-363a-4c30-94b1-80850a202c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:14.846650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:14.847675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:14.848522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 271/554] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:14.852775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1eed-f282-410e-90e6-52f438e692d1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.852775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1eed-f282-410e-90e6-52f438e692d1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.852775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1eed-f282-410e-90e6-52f438e692d1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.853398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 272/555] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:14.864129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc40e-4990-405b-a904-13053369f480 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:14.864678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc40e-4990-405b-a904-13053369f480 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:14.865238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cc40e-4990-405b-a904-13053369f480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:14.883811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 284/556] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:14.884709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:14.893210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-285cc40e-4990-405b-a904-13053369f480 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:14.894522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-285cc40e-4990-405b-a904-13053369f480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:14.980072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 273/557] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:14.981442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cc40e-4990-405b-a904-13053369f480 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.042309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.052653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7fa3d-497b-428a-a799-17598034aa40 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.072706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.095823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.096542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.096909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.097243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.097995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:15.098365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.099846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.115235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 285/558] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:15.116356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.133094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cc40e-4990-405b-a904-13053369f480 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.176186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.176869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.177140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.177451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.190826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:15.196683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:15.197705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:15.198679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 274/559] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:15.199884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.245754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47614-b3fc-4154-9d46-49d831ed2217 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.292794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.293977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.294496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.295055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.310649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.314507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:15.334207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:15.335290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:15.336194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:15.336194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.336194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:15.336194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 286/560] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:15.336430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.341392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5308f8-7635-4f10-ac4e-a513db2a49a7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.352735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.376053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.390592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.391266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.391540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.391803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.408340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.409868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:15.428876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:15.430054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:15.431128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:15.431128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.431128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:15.435885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 275/561] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:15.435885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.477279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de813da-fa21-47e2-a40d-7d78549d1740 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.526954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.527598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.527876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.528145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.528864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:15.529172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.531445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.545407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 287/562] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:15.545407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.563848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85088-a7ba-4687-ba32-730c7f83032e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.608249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.608972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.609251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.609524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.630109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:15.635373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:15.636403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 276/563] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:15.637366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.654824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.694481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.712846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adedfca-a0ab-4561-8d8b-0de88989de7e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.762021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.762650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.762914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.763189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.763964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:15.764290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.766533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.785641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 288/564] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:15.785641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.800562 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929284-e3ab-4304-9c64-985d8083b62a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.843468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.844268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.844377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.844626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.845326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:15.845628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.847089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.860412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 277/565] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:15.861654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.901142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265715c-256f-49ea-98f2-bafbc87feb85 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:15.934032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.940469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:15.941153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:15.941421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:15.941691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:15.959909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:15.961383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:15.977383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:15.986457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:15.988001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:15.988001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:15.988001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:15.988275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:15.988368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 289/566] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:15.988368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:15.990603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc843935-4233-470d-8505-412d34e73c5c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.026467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.027078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.027349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.027615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.028278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.028577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.030168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c251-adc5-49ae-993f-02e2cab5a7d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.039251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 278/567] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.040691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492a68-7592-4908-adb2-fe6faa19bc1a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.041001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492a68-7592-4908-adb2-fe6faa19bc1a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.041267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30492a68-7592-4908-adb2-fe6faa19bc1a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.042551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 279/568] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:16.043248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30492a68-7592-4908-adb2-fe6faa19bc1a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.099044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dd406-6c71-465e-bda4-936ef2cabb15 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.135683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.136324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.136603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.136900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.145173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.146652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.152918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30492a68-7592-4908-adb2-fe6faa19bc1a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:16.159369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:16.160496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:16.161653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 290/569] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:16.162137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.190659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.191303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.191577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.191847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.200305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.202727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.211440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:16.215147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:16.216135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:16.217357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 280/570] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:16.218088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.238803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.274983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8893df7-f0a6-49b9-a8e6-302530169c4d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.313334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.314067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.314224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.314496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.315147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.315453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.316867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9e1f2-818b-4ed0-87df-e53a7f10cca3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.327746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535947be-4a0e-49d1-8550-38da7cb8876b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.329946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 291/571] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.331223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.331504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.331775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.350524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:16.351743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:16.364970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.365613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.365885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.366148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.378413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.379870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:16.395012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:16.396270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:16.397393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:16.397393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:16.397393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:16.397393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 281/572] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:16.397393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.430669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 292/573] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:16.431518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.470691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.474084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.512388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d56e2-f046-4c00-ab4d-9ec2f68cd14d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.561285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d470e3-6566-4541-9f9c-e73bc21ee51b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.563405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.564302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.564756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.565223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.566209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.566336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.568567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.605154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 282/574] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.605154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.621435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.622408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.622686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.623354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.624073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.624408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.625926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.650391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 293/575] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.650391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.727987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85cb0e-468b-45ef-924f-1011c1d065b8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.758567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.759917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:16.769287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.769947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.770224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.770332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d3d55-b862-440e-aeb0-e35d42439b7e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.770491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.786434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.788431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:16.801528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:16.803055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 283/576] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:16.804630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.813185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.813802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.814164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.814436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.815088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.815386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.816789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.830761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 294/577] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.831469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:16.929014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cdb49-9718-4e53-91d8-b2616c576d5a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.956632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6adfc-8fcc-4187-b66b-43972304ad8b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:16.966444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:16.967387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:16.967657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:16.967929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:16.968865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=746f454bf6df48378388ac7372961998) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:16.969164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:16.970617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:16.976358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 284/578] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/role_assignments?user.id=746f454bf6df48378388ac7372961998&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:16.977184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.000583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.001205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.001463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.001729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.020337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.022728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:17.048227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:17.049365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:17.050281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:17.050281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:17.050281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:17.050281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 295/579] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:17.051293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.052221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.058277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.108119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6a103-1e5d-46d4-8eaf-6082a0ff1a2d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.146333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.147235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.147517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.147817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.160623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:17.166195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:17.167155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:17.168145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:17.172340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 285/580] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:17.173330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.205405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89e7a1-db27-47fe-8b99-0db2ff798f40 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.243770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.244886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.245357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.245816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.247105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:17.247646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.249533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.270272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 296/581] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:17.271502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.288702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc06a4-aed3-4471-b1b7-0ba4da05ba1b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.305161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.328278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.328947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.329218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.329479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.338000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.339942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.340403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:17.354849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:17.355906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 286/582] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:17.358092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.391113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df000cb-5f5b-43e6-bb66-08dbed16b0f9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.433182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.433801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.434081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.434350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.435002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:17.435304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.436727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.449870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 297/583] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:17.450548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.473480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8acdcb-369a-4376-b250-f91873c6e6ed None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.519906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.520733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.520978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.521247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.522024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:17.522325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.523749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.533185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 287/584] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:17.533905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.577967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e52311-37a1-465e-8919-518fe72e6ac3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.578182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.608989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.624937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.625595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.625908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.626261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.642921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.643274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:17.662151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:17.663186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:17.664075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:17.664075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:17.664075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:17.664075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 298/585] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:17.666061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.682395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48c9b2-f3d3-4c74-b408-6734452cf382 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.743936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.744539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.744855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.745123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.745870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:17.746172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.747927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.776907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 288/586] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:17.776907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.812063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8428c-2232-4bff-931b-61f067a4371a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.853597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.854243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.854522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.854780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.863325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.864894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:17.883563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:17.885363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:17.886241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 299/587] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:17.886735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:17.908278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.921831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96230446-5884-46b9-8c23-97d2abb989fc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:17.934084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:17.971379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:17.972032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:17.972396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:17.972808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:17.985613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:17.988169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:18.008307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:18.009676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:18.010886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:18.010886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:18.010886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:18.011659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 289/588] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:18.012032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.032524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf138c04-6c82-4483-a740-04b15dbff1de None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.080590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.081297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.081575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.081905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.082566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:18.082868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.084251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.101098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 300/589] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:18.101985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.160987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95b55-1683-49fc-9686-82ccd162d1a9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.206107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.206594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.206869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.207136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.219020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.220597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.228579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.235615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:18.238550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:18.239729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:18.240841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:18.240841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:18.240841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:18.242553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 290/590] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:18.245031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.256233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910952-8677-4ad0-be66-1a92e5a227c7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.313458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.314326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.314611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.314914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.315996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:18.316298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.318265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.338761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 301/591] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:18.338761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.384039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870210e7-2298-4c57-97af-24df60ec8ff0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.430874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.431785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.432201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.432643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.433497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:18.433933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.435696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.450048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 291/592] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:18.450891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.463725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d6a93-9ed6-4755-bd6d-88256f612039 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.503805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.504729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.505185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.505645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.513259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.515030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.517811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:18.533775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:18.535044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 302/593] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:18.536144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.554393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.569977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e80f-d9c8-4a36-93f6-20e5e1da3f4f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.614189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.615390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.615670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.615938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.616959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:18.617261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.619855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.634211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 292/594] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:18.635199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.663144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34122e-ef7b-4488-8cb3-d5f639b01d06 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.703021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.704228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.704858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.705302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.731165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=c5df08926dfe44f3ac00d11414e3513e, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.733856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.752201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 303/595] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:18 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:18.753493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.769113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0153a7-5672-4415-b32e-1d1f1ffe0bd4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.797508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.828927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.830210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.830501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.830776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.843368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.845233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.850543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:18.866038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:18.867315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:18.868494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:18.873532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 293/596] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:18.874642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:18.922626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2fa85-97e1-4bff-8379-9bcdd89c2d99 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:18.966499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:18.967734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:18.968348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:18.968684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:18.969390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:18.969693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:18.971142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:18.985016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 304/597] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:18.985016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.006472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a979832-5a71-4830-a0a4-0211d415fc28 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.045423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.046176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.046443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.046706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.053835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.055267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d2f7cfab-3273-495d-ad55-eb8bead4dcc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:19.067302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:19.068473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:19.069657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 294/598] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:19.070318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd38a-e44f-4236-bf0d-8e5e6a343c39 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.070318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd38a-e44f-4236-bf0d-8e5e6a343c39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.070572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd38a-e44f-4236-bf0d-8e5e6a343c39 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.071994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 295/599] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:19.072512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cd38a-e44f-4236-bf0d-8e5e6a343c39 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.131485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.138889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d9b0-f16e-4dfd-b52b-6ad40577ff0b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.173467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.188217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.189032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.189387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.189758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.190572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:19.190961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.192475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.212439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 305/600] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Aug 29 20:00:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:19.212629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cd38a-e44f-4236-bf0d-8e5e6a343c39 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.213068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.255721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.256397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.256660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.256964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/4fa74e5d2adb4da1afcecdb718be98f4/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.275170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=4fa74e5d2adb4da1afcecdb718be98f4, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.276798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e131-b1b1-4b57-a2e6-fbdfd9d40fc4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.299739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 296/601] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:19 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/4fa74e5d2adb4da1afcecdb718be98f4/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:19.299739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.299739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.299739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.316139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:19.318490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:19.343999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a0bb-6c4e-486f-be30-b125b830c15c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.391683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.392241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.392570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.393320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.394070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:19.394379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.396001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.412922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 306/602] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:19.413790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.420136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 297/603] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:19.421447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.449300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.464259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.576380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6abad8-5332-4655-9cf0-82ec97331a5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.583475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35f633-10ac-4325-b650-eeff94b88698 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.619549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.620524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.620846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.621104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.634383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.635682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.636053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.636412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.636899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/b756232a28874eba8520a100216a156a/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.637630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:19.661769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:19.662797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:19.663719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:19.663719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:19.663719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:19.663719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 307/604] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:19.664739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=b756232a28874eba8520a100216a156a, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.666136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.671941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.690566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 298/605] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:19 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/b756232a28874eba8520a100216a156a/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:19.837508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.863097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.871204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c092a-cf81-49ee-9016-0f2663135de0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:19.929789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:19.930381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:19.930661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:19.930940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:19.931712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:19.932018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:19.933555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:19.949593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 308/606] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:19.955447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:19.960304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:19.998823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91be3-f084-4b26-8887-8c3bd261ce7c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.036818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.037457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.037728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.037998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.052969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:20.058177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:20.059116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:20.060410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 299/607] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:20.065972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.074908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3343-d385-4a82-8ae2-7b7f5fc2265c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.119405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.120055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.120333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.120600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.137388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.138995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:20.168546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:20.169547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:20.171497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:20.176881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 309/608] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:20.178040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.178151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1bb2-4b3f-45fa-97dc-d22fe6fcb6d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.209233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:20.218897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:20.220280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.221678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.222252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.222815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.223784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:20.224256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.225889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.236164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 300/609] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:20.241976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.397005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a59dc6-3c2c-469f-a83f-28930659dcee None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.446963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149fe2d-cf40-44b3-a7fa-11c002e5bc52 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.471618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.472899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.474996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.475417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.476290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:20.478037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.479798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.508979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 310/610] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:20.512980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.524360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.525291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.525710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.526124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.544532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.547330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:20.577578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:20.578835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:20.579887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:20.579887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:20.579887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:20.579887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 301/611] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:20.589779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.650136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:20.697991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:20.708685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293946db-f46e-4389-b90b-ea572a06d1aa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.745820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af3614-46c0-40c1-9fd5-c3c2c08dc16d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.768181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.769318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.769956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.771736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.772930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:20.773413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.775676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.804989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 302/612] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:20.815040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:20.831158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.831854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.832130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.832401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/b25325b450fe4a14941600dd16c557fb/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.850496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=b25325b450fe4a14941600dd16c557fb, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.851960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaa9f9-8567-480e-a40f-a0554a161811 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:20.871277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 311/613] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:20 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/b25325b450fe4a14941600dd16c557fb/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:20.873335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ddc0-9e39-486a-8a57-575d942461ad None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.873696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ddc0-9e39-486a-8a57-575d942461ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.874013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798ddc0-9e39-486a-8a57-575d942461ad None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.880307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 312/614] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:20.881838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.882203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.882474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.902419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:20.903642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:20.943276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f54dd-43da-4d5a-b87b-1430e1124899 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:20.945506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:20.985145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 313/615] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:20.985972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:20.986812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:20.987400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:20.987815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:20.997538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:20.999687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:21.015776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:21.017345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:21.019186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:21.021729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 303/616] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:21.028073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.116681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:21.182708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb364e-3953-412f-96fb-d428b290b0a4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.231515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.232496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.232949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.233483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.234446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:21.234925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:21.236549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.268891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 314/617] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:21.274833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.333776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.398441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aaea4-337a-4464-994a-2ad46daba279 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.439398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.440296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.440724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.441172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.454002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:21.456017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.461388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cd4-85cb-42dd-af24-d51991dc3530 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:21.472411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:21.473482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:21.474385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:21.474385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:21.474385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:21.476044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:21.477471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 304/618] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:21.484178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.499466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.500317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.500472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.500634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.525224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:21.526172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:21.531300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:21.532626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:21.533694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:21.538258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 315/619] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:21.542763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.696702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c883-5ec2-45d8-b67f-064f2d79870c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.703131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570366-85cc-411b-b6fa-51197b06b71d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.734418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.735050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.735326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.735592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.736276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:21.736583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:21.738033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.748001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 316/620] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:21.753567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.767666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.768348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.768630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.768926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.769581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:21.769978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:21.771460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.791034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:21.808552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 305/621] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:21.814256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:21.863058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be635c71-7cbc-40f3-a783-72c8a4366db0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:21.909119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:21.909766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:21.910042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:21.910309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:21.931980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:21.933490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:21.967646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:21.969126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:21.970028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:21.970028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:21.970028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:21.970202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 317/622] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:21.970994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:21.978698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.010935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fecc-349b-4711-99db-2c60c5f257bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.063344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.064063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.064466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.064737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.076899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.080160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4b8de86e-16b8-4d78-bf36-f60b9dc5de52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:22.099137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:22.100126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:22.101933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:22.102572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:22.104922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 306/623] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:22.107401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0ad-1687-4168-b5ae-94b0385a5423 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.107684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0ad-1687-4168-b5ae-94b0385a5423 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.107952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0ad-1687-4168-b5ae-94b0385a5423 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.111705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 307/624] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:22.112704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f0ad-1687-4168-b5ae-94b0385a5423 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.117575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4253-def7-4dd4-b2c6-88c072828847 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.156557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.157238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.157554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.157816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.158471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:22.158769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.160154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ac848-b460-4cde-94d4-7deae6fccf91 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.175220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 318/625] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:22.176918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.177197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.177467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.198081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:22.199286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:22.231686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f0ad-1687-4168-b5ae-94b0385a5423 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.272156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.272814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.273190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.273462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.274268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:22.274574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.276134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.282779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 319/626] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:22.283729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.293157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:22.296068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 308/627] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:22.297165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.401696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:22.422977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf570c-5afe-4124-876c-724f1056e3d4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.436263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bfbd2-804a-4553-82fc-4ecbfe1e4079 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.472848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.474593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.475090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.475563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/746f454bf6df48378388ac7372961998/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.495625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.496429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.496931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.497732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.503600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=746f454bf6df48378388ac7372961998, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.507022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.509318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.512986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.532785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 309/628] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:22 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/746f454bf6df48378388ac7372961998/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ba3b3af3-3d68-4bfb-9f23-3b74ea4c8c7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:22.533034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:22.534080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 320/629] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c426-fb1f-4029-9203-8972e26f3e12 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.535051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c426-fb1f-4029-9203-8972e26f3e12 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.535793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97c426-fb1f-4029-9203-8972e26f3e12 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.536178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 321/630] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:22.541736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.542198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.542640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.542973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.582140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:22.583621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:22.643489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:22.705551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 322/631] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:22.706562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.735499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bb269-1488-41bd-be2b-fb6308bb6c75 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.806839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.807564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.807841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.808109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.808904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:22.809181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:22.810822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:22.817155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:22.840912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 310/632] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:22.846519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:22.901342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839be1b-c29c-4773-b09a-f47e0ae7d6a1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.974592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef8062-eb4a-4a3f-b1d5-ce8201e7cd5b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:22.976925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:22.977751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:22.978160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:22.978565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:22.989127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.007433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:23.012489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:23.013843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 323/633] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:23.014815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.019396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.020074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.020380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.020656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.120321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.122292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.153581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d3866-a5bd-420c-bab8-3fcf912e5958 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.186769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.197367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.198107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.198449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.198800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.211589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:23.217372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:23.218546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:23.219399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:23.223732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 324/634] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:23.224868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.244002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 311/635] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:23.245241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.250270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.359247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e68a5-883a-4d16-bcb6-963d5d420554 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.361290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa57c-89eb-42ab-9b1a-635c7b9dea4a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.400779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.400779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.400779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.400779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.401229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:23.401229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.401229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.401412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.402171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.402603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.407149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.407149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:23.407149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.407149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.410899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 325/636] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:23.411773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.420557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 312/637] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:23.421630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.468488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.499496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.528055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fccbc-36c7-4a3c-9f96-5627cc2b956f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.545304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094c21-bab7-49c7-85c8-8f28d4606542 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.564301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.565060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.565409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.565750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.577833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.579418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.583698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.584423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.584790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.585137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:23.596779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:23.598050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:23.599211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:23.599211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.599211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:23.599721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.600621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 326/638] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:23.605489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.605589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-de2b90ab-2dfd-4c41-83b9-bdb2b558ea33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:23.619947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:23.621189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 313/639] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859900-1fd0-439e-a9d3-84ccf3b0b025 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859900-1fd0-439e-a9d3-84ccf3b0b025 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76859900-1fd0-439e-a9d3-84ccf3b0b025 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 314/640] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:23.627697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76859900-1fd0-439e-a9d3-84ccf3b0b025 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.731192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.734522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab86c-5624-4465-bf3f-df79a31baca3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.752988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76859900-1fd0-439e-a9d3-84ccf3b0b025 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:23.771476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:23.772104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.772834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.773126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.773605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.786361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.788050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.795318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:23.795318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.795318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.795318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.795956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:23.795956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:23.797131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56d41-b834-47aa-a6d1-93d7cdedd358 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:23.805616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:23.806696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:23.807652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:23.807652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:23.807652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:23.807652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 327/641] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:23.808068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.820242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 315/642] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:23.820242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:23.820242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:23.820242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:23.848105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:23.850145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:23.945832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 316/643] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:23.946982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:23.986069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadef68-3109-4d37-a816-1fa553ef2beb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.039253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.040171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.040626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.041243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.042108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.042550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.044798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.062677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 328/644] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:24.063895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.076097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dac03-8212-4d16-94a7-3a2d812b511d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.081936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.085062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.117071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.118121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.118551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.119207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.119813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.120271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.123308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.142385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 317/645] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:24.143505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.185834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70bdd4-2b72-4d9f-8462-1c9b00776f64 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.231709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.233078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.233721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.234282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.245454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.248060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:24.266839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:24.267876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:24.269021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:24.269493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403644ed-d4f9-401b-a4a3-417a11f19dd4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.276807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 329/646] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:24.276807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.323431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.323946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.324288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.324556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.336361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.337869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:24.351121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:24.358856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 318/647] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:24.359996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.401640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.405592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.442560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb565f5-6a90-4e50-a63e-4dff00918991 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.490360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.491806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.492399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.493108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.503687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.505330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.508370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8fc86-ab9a-4fac-be53-b321679fb28e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:24.518405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:24.519471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 330/648] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:24.526213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.562649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.563498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.563771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.564203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.585671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:24.592325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:24.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:24.594269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:24.598535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 319/649] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:24.599473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.692708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d8a6-b32a-4caa-8f7c-aac9176e6c59 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.726621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.742045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:24.745774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16e67c-ed59-48b8-ac6e-dadf195d3e0c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.748587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.749248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.749524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.749821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.750507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.750803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.752275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.767521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 331/650] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:24.768903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.786399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.787247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.787632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.787997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.789003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.789309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.790801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.810181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 320/651] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:24.811046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:24.922645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068b17-ff99-4063-a63b-593af16d5699 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.931633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f628e4-0547-406f-a57d-a55ffffec229 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:24.965458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.966073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.966349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.966726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.967477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.967875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.969413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990b5cc-cf74-4549-a110-551c7be4eefa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.982647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:24.983376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.983787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.984139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.984935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:24.985318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:24.987194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:24.990398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 332/652] 10.222.0.61 () {56 vars in 1137 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:24.991468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a734a0-6962-4ffe-b001-640468ba6773 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:24.991753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a734a0-6962-4ffe-b001-640468ba6773 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:24.992042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a734a0-6962-4ffe-b001-640468ba6773 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:24.999919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 333/653] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:24.999919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a734a0-6962-4ffe-b001-640468ba6773 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.000220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 321/654] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:25.000220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.013585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.062907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.125475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a734a0-6962-4ffe-b001-640468ba6773 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.137164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32d85c-5f62-42e5-8277-c2dec01dcf58 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.168778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:25.169901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.170280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.170560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.171283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:25.171612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:25.173141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:25.179434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 334/655] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:25.180262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.184681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:25.185364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.185740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.185962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.304810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:25.307044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f147fa0-a0a7-44bd-8515-e1073a194d0c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:25.321017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.364863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c0e09-eeee-48cb-a411-7f625ec21296 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.394073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.437352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:25.438006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.438286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.438555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.472198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 322/656] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:25.477497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.477772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.478046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.498154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:25.499785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:25.522208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:25.523719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:25.599790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 323/657] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:25.601001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.649825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.683919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 335/658] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:25.683919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.705328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.768272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf13c9-acad-4753-b102-75ea4bd9d2cd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.807650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:25.808299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.808575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.808888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.820447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:25.821955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:25.836172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75882f-b2ae-4a5a-acdd-e07f54827d54 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:25.837637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:25.838583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:25.839485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:25.839485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:25.839485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:25.843863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 324/659] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:25.844814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.879408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:25.880466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:25.880999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:25.881463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:25.892800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:25.894268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:25.909395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:25.910569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:25.911626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:25.911626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:25.911626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:25.911626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 336/660] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:25.911626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:25.947472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:25.963515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c4e38-0710-4e9f-8a88-8b3c1ff7bfbd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:25.983761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.003582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.004310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.004709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.004925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.018004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.019573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.025436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976537a-f137-490b-9045-d72488a8bf2e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:26.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:26.036959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:26.037961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:26.037961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:26.037961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:26.037961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 325/661] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:26.037961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.067395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.068003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.068274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.068536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.069245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:26.069518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.070913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.088908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 337/662] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:26.088908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.163000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f42845-2c05-4660-abf6-50cf55f5f9f8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.199323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.199980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.200235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.200492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.210243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.214578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:26.219902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:26.221830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:26.223713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:26.225962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 326/663] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:26.226794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.248182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d194333-917a-4352-b393-0783f2edc9fe None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.287940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.299328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.299897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.300174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.300439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.301123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:26.301425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.302911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.317693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 338/664] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:26.318993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.351564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca3018-7c74-4479-9391-1bac447d77ca None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.394471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.394860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.395029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.395284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.395929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:26.396222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.397639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.416109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 327/665] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:26.416109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.442533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a3a90-58f6-48e3-b54d-801d1e7b0582 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.479267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.479467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.481010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.481423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.481728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.490451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.491931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:26.504062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:26.505129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 20:00:26.506312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:26.510235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 339/666] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:26.511050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.528465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5bef-031b-4ff7-af7c-1c3e090320cc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.561163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.568526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.569267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.569541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.569808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.570470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:26.570773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.572256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.587610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 328/667] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:26.587610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.629479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59480-ba5b-4580-bf02-f93d4458745c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.669390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.670247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.670599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.670961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.679375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.681059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:26.693321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:26.694470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:26.695514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 340/668] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:26.696071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.714203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc0674-24a0-489b-861a-feadc2bda552 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.738155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.750980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.751615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.751887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.752159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.759427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.760904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:26.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:26.776885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:26.777833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 329/669] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:26.778330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.817598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad621d2e-61cd-42cc-a65b-1251447c5a02 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.825222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:26.862765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.863468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.863748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.864027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.864793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:26.865131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.866615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:26.896824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 341/670] 10.222.0.61 () {56 vars in 1139 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:26.896824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:26.923237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d43dc-9b98-4588-b1a6-4d69ccea47b4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:26.972380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:26.973069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:26.973348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:26.973616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:26.991958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:26.994686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:27.021998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:27.023302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:27.024389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:27.024389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:27.024389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:27.032284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 330/671] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:27.033691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.044723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da3ad5-10db-4b01-bea5-9f42ccb29d51 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.085546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.086386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.086689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.086960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.087678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:27.087979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.089493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.097976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.108327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 342/672] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:27.108327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.143003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.229929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9df96-67bc-46b5-b6ae-928d220e1cd7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.230844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd5b4-78ae-4180-a1f9-87976579e3ea None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.272123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.272363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.272646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.272954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.273048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.273219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.273325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.273538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.273910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:27.274203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.275649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.289157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 331/673] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:27.289603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.352642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.354143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3c999-da37-4973-b2c7-ba07b3de7f0f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.379542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.390822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.397811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98f91c-8144-4853-a0be-28f9d0edf151 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.436527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.437160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.437513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.437685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.438327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:27.438620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.439993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.451733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 332/674] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:27.453051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 343/675] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9779-90af-4d67-b7ad-b8b118e1d97b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9779-90af-4d67-b7ad-b8b118e1d97b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9779-90af-4d67-b7ad-b8b118e1d97b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 344/676] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:27.471053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9779-90af-4d67-b7ad-b8b118e1d97b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.564375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b937-ac87-42ee-b2f9-4cb9bdf5c420 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.583682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9779-90af-4d67-b7ad-b8b118e1d97b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.599097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.599704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.599973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.600245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.600998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=4fa74e5d2adb4da1afcecdb718be98f4) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:27.601299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.602725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.609500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.610317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 333/677] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/role_assignments?user.id=4fa74e5d2adb4da1afcecdb718be98f4&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:27.611146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.633764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.634921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.635393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.635878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.636834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.638619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=b756232a28874eba8520a100216a156a) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:27.638619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.640849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.647994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 345/678] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/role_assignments?user.id=b756232a28874eba8520a100216a156a&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:27.654117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.765933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7186c-e112-42f2-94f5-74bf70192391 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.815729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.817443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.817443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.817443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.826379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.828020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.833315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544704c-3d6e-471d-85ce-bb3a873a0447 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b03f19fb-7a1d-4f87-9de9-4391d5a01d65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:27.844197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:27.845290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:27.846241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:27.846848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 334/679] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:27.847525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.847870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.848267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.869091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:27.870403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:27.875416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:27.876067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:27.876342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:27.876607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:27.890829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:27.892517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:27.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:27.912971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:27.913853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:27.913853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:27.913853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:27.913853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 346/680] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:27.914084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.958172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 335/681] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:27.959210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:27.976074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:27.978471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.053121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d773f8-11f3-4b73-b036-664dbfccbd34 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.092994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.093540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.093813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.094084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.094835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:28.095141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.096817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.098263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014803-0de7-49c3-9f6f-2d8d3ec5522d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.134979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 347/682] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:28.141176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.144640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.145425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.145710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.146127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.146862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:28.147166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.148548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.171226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 336/683] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:28.177039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.306887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.323323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.331573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c408a3-6e29-4def-8f5d-2794273988ee None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.363043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8cc3-ccd4-4f54-8526-e4d8d29353bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.378695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.379315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.379587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.379851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.406468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.407439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.407895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.408375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.416789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.418492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:28.432554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:28.433765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:28.434948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:28.437832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 337/684] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:28.439001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.470759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.473203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.556251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f71f-99ae-463d-811e-093f7d8cd202 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.587803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.603031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.604001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.604419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.604886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.609821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.620303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 348/685] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 20:00:28.620303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.625859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:28.631712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:28.632850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:28.633717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:28.636059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 338/686] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:28.637162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.727856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4597-5a56-4949-8d9d-cdaabe045408 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.762963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793faa0-54a6-48be-861b-980b269538b9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.764399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.765132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.765407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.765672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.766415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:28.766838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.768680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.781028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 349/687] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:28.781965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.806078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.807140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.807637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.808104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.822026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.823907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:28.841169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:28.843017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:28.843950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:28.843950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:28.843950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:28.844973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.846098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 339/688] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:28.847135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.892257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eea6a-bba9-41f1-a658-fedc887605c2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:28.900068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:28.930630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:28.931241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:28.931512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:28.931776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:28.932506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:28.932729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:28.934326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:28.943806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 350/689] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:28.944706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:28.975328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ea7f-bb37-4b55-8d9a-9da248ebced2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.017682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.018734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.019271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.019803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.020980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=b25325b450fe4a14941600dd16c557fb) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:29.021570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.023342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.031499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 340/690] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/role_assignments?user.id=b25325b450fe4a14941600dd16c557fb&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:29.032837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.056391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70804594-f079-42ed-bbb9-ee024506dc40 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.081027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.103162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.104575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.104894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.105168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.106388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:29.106690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.109141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.127907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 351/691] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:29.136446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.176045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a0a-bfef-4bec-80ab-962d80f6ca63 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.179336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.221467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.222551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.223029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.223620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.237660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.239566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:29.258014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:29.259097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:29.260035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:29.260035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:29.260035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:29.264678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 341/692] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:29.268395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.345078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc9b77-e44b-47a4-817d-cbec1d6a066b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.384173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.384848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.385131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.385402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.393816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.394502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:29.408232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:29.409325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:29.410874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:29.414926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 352/693] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:29.416241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.439467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20f20-6adc-4578-b9da-2a3a7a3870fb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.463865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.489580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.490379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.490768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.491045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.491711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:29.492015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.493490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.509220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 342/694] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:29.517276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.543814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.544207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9623d-54f5-4306-8fbe-ad8e1963bfa5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.592434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.593468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.593946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.594431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.595429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:29.596017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.597698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.613171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 353/695] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:29.622315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.661438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4399-6bc0-4dc7-ae27-c918f4d42624 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.744862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.745487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.745759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.746007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.769700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.773698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:29.808349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:29.809444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:29.810863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:29.813073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 343/696] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:29.818451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:29.884502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.892016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba32f9-deb1-476f-ab87-5e1267fd0e66 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:29.957240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:29.958168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.959096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.959096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.960300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=746f454bf6df48378388ac7372961998) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:29.960797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:29.963396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c28a4-a83a-4eee-a3d6-dbbe5c2dd9c8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:29.973497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:29.980775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 354/697] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/role_assignments?user.id=746f454bf6df48378388ac7372961998&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:29.980775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f64c-f084-4361-8edc-f166dc53afdc None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.980775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f64c-f084-4361-8edc-f166dc53afdc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.980775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82f64c-f084-4361-8edc-f166dc53afdc None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:29.982250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 355/698] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:29.990269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:29.990619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:29.990808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.022180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:30.023112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eabd7-f7dd-4c95-b0a6-cfb5a28f55b5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.023350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:30.065046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.065685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.065982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.066233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.066992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:30.067416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.069106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969cc5-1fec-4a36-b6a1-36d0fdf82d7a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.090798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 344/699] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:30.092595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e4d-7651-4c14-8fab-b13b0e78f23f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.092916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e4d-7651-4c14-8fab-b13b0e78f23f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.093256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f5e4d-7651-4c14-8fab-b13b0e78f23f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.099005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 345/700] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:30.100415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.100694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.100993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.111004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 356/701] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:30.111978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.121625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:30.123404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:30.202658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 346/702] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:30.218436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:30.227365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086a9fd-2d8e-48c8-84f0-c24d517bba15 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.266450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.267081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.267364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.267632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.344891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.346428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.454569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:30.454793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.466214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 357/703] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:30.472469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.535240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:30.582909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0977a7-7291-45d9-a0ae-b9e7a4b2e36d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.615705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d00e-0722-4450-abd3-38b0c2023dcd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.632709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.633586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.634307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.634529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.635145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.636564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:30.652809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:30.654044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:30.654901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 347/704] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:30.655696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.675733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.676406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.677238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.677238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.693637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.696662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:30.721007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:30.722065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:30.722978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:30.722978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:30.722978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:30.725592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 358/705] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:30.726676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.802225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:30.810023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f0372-fd19-4f37-b98f-4a2711197d4a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.840895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:30.851285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.852434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.852940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.853502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.867014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.869112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.875731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84430fe-61f9-4d57-a40f-24a666a615a4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:30.887980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:30.889074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:30.890021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:30.890021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:30.890021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:30.892502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 348/706] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:30.893693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:30.920377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:30.921077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:30.921313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:30.921587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:30.922290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:30.922590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:30.924182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:30.929957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 359/707] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:30.931397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.005267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b414b-a68f-4a23-ba26-9753909b07df None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.040505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.041496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.041797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538b00e-9008-434a-b27e-287c922d9231 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.042222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.042683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.043518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:31.044010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.046087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.053435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:31.060514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 349/708] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:31.061704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.086925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.087525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.087801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.088074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.088811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:31.089120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.090721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.108940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 360/709] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:31.109695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:31.111134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.172566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113609e-7055-4f59-a2dd-4987bb533623 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.208853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.209850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.210351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.210817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.211645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:31.212141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.213814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.220356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 350/710] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:31.221517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.222951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cacbd5-d21b-4993-92c3-b8f7d33106a8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.264310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.264992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.265271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.265541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.273594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.275252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:31.288605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:31.289607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:31.290503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:31.294630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 361/711] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:31.295930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.339374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f4b77-d023-4e22-99ae-878a523dd6a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.343728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:31.358530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:31.383878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.384943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.385451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.385958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.386823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.388696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.423244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 351/712] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:00:31 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:31.465659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccddd0f-98f4-4505-96a2-0289715b124a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.509993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.510629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.510958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.511234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.511946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:31.512254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.513947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab58e-9d41-4d54-9b0b-8fd3d76921d4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.529197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 362/713] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:31.535271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:31.671990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48432-6680-4d27-a95b-204ab9360b04 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.672641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48432-6680-4d27-a95b-204ab9360b04 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.673190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b48432-6680-4d27-a95b-204ab9360b04 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.675266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 363/714] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:31.681032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.681437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.681810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.685404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8a93-ee2f-475b-91b1-5c76cfbbd059 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:31.704063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:31.707795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:31.732936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:31.733908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:31.734372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:31.734779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:31.735671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:31.736216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:31.737834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:31.744879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 352/715] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:31 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:31.793102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 364/716] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 20:00:32.081845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:32.114069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:32.231388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a7a00-aee0-4811-b12c-a0f1a2a2f450 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:32.280361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:32.281316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:32.281773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:32.282226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] PATH_INFO: `/v3/services/network` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:32.282991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:32.284573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b8ad9f5f-4434-4324-9040-45a6f88af889 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:32.295178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:32.296538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:32.297633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:32.300094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 353/717] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:32 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:32.306098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:32.348451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:32.487984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc83e4a-bf67-4a8b-80f6-fef7cf06cb4e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:32.509344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f645c4-b2fe-4598-a488-dcdd238870b7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:32.509904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f645c4-b2fe-4598-a488-dcdd238870b7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:32.510320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f645c4-b2fe-4598-a488-dcdd238870b7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:32.511871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 354/718] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:00:32.530019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:32.530453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:32.531149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:32.542289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:32.543309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:32.543840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:32.544465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:32.545317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] RBAC: Adding query filter params (name=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:32.545789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:32.547358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:32.554207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 365/719] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:32.566256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:32.569798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:32.571872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:32.717629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 355/720] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:32.733173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:32.782093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8b33-ac23-4b89-95d4-0574767d2b8b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:32.848108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:32.849165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:32.849643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:32.850116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:32.851207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] RBAC: Adding query filter params (type=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:32.851777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:32.854242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:32.865561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 366/721] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:32.997576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:33.025969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:33.143944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63dee7-8cb3-4b48-9948-188251f14065 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:33.207084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:33.208066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:33.208499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:33.209118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:33.231492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:33.240943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:33.241898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:33.242736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:33.246052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 356/722] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:33.254277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:33.411610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915d83-d500-4ea6-b48e-74f244d0314b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:33.488953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:33.490003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:33.490493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:33.490963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:33.492106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:33.492686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:33.495168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:33.512655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 367/723] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:33.518496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:33.640835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:33.689038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0512-ae4a-45b3-803b-5fe2718d3817 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:33.743119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:33.744272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:33.744771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:33.745259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:33.757750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:33.759543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:33.775582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:33.776636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:33.777631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:33.777631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:33.777631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:33.779886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 357/724] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:33.786698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:33.808539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:33.935551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889b3b-ac6a-4646-9ac5-8c21bca32fe4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:33.971457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:33.972076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:33.972347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:33.972612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:33.973354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:33.973858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:33.975236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621761b-219a-4a85-9250-d161db4bae5d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:33.990902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 368/725] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:33.996664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:34.012308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb0cd-5761-4af2-a1e1-701b9a8251ac None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.012646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb0cd-5761-4af2-a1e1-701b9a8251ac None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.016874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cb0cd-5761-4af2-a1e1-701b9a8251ac None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.016874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 369/726] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:34.021843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754605ae-9880-47e7-9ef2-d63069b167b3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.022272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754605ae-9880-47e7-9ef2-d63069b167b3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.024791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754605ae-9880-47e7-9ef2-d63069b167b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.066232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-754605ae-9880-47e7-9ef2-d63069b167b3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:34.067479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-754605ae-9880-47e7-9ef2-d63069b167b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:34.130267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96209720-7f28-41a9-b8ae-bca17cab1b20 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:34.167537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:34.182896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:34.184093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.184372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.184867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.194527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:34.196879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:34.199102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:34.201628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 370/727] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:34.203087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96c38-d398-4e95-b659-8d7f5027d732 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.203465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96c38-d398-4e95-b659-8d7f5027d732 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.203831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96c38-d398-4e95-b659-8d7f5027d732 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.205474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 371/728] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:34.220373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.220772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.221020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:34.221674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:34.223067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:34.224026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 358/729] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:34.229692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:34.257640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:34.258835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:34.386210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 372/730] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:34.408338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84699b-bcbe-4752-94ec-3d821f836f4c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:34.450701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:34.451296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.451636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.451930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.452666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:34.452997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:34.454504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:34.478274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 359/731] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:34.484838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:34.558610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:34.660393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:34.689546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09b699-0691-4d50-8701-dce1b3eba981 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:34.727454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:34.743622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:34.744538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.745001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.745432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.771591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dccbe2-f566-46c1-b5e7-e82b17674b59 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:34.811031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:34.811645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.811930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.812192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.812891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:34.814266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447819d3-3eb6-4af3-b169-aeab074ebc3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:34.845035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 360/732] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:00:34 2022] POST /identity/v3/services => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:00:34.852425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088edf2-f97e-4526-bb16-235db60bc1e7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.852425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088edf2-f97e-4526-bb16-235db60bc1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.852425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088edf2-f97e-4526-bb16-235db60bc1e7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.852425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 361/733] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:34.852425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088edf2-f97e-4526-bb16-235db60bc1e7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:34.864505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:34.866624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529adb8f-b793-48ac-b76a-4d2221eea946 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:34.995189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 373/734] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 20:00:34.996485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088edf2-f97e-4526-bb16-235db60bc1e7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:34.996725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:34.997074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:34.997628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:34.999737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.020209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:35.021677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:35.040967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.041622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.043957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.043957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.053480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.054986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:35.059974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:35.061098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:35.062159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 362/735] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:35.062880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.135367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 374/736] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:35.136654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.268201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bf41c-3b12-4ec2-9d71-3475bec1804c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.308381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.309077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.309351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.309619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.321826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:35.323310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:35.339885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:35.341098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:35.342006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:35.342006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:35.342006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:35.342006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 363/737] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:35.349777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.381230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.426656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68d2f2-c11f-47c4-b5ba-69dbc322db66 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.490671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ff5b2-4449-4b21-af92-c57b78c3e053 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.492081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990409d-a170-440b-b855-86d896619cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.493368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990409d-a170-440b-b855-86d896619cce None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.493708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990409d-a170-440b-b855-86d896619cce None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.494047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990409d-a170-440b-b855-86d896619cce None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.494846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990409d-a170-440b-b855-86d896619cce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:35.495216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990409d-a170-440b-b855-86d896619cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:35.497028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990409d-a170-440b-b855-86d896619cce None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:35.507269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 375/738] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:35.512767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990409d-a170-440b-b855-86d896619cce None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.536051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.537023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.537494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.537930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.539406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:35.540060 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:35.542040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.542544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:35.558973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 364/739] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:35.560053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.647080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990409d-a170-440b-b855-86d896619cce None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.682031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.708033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.709152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.709914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.710196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.717899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc5d6b-70ac-4466-9b7f-6a5f37ac496c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.724959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:35.731119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:35.732629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:35.733987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:35.738043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 376/740] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:35.740092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.781324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.782364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.782786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.783218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.799836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:35.801639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:35.817644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:35.818713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:35.819651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:35.819651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:35.819651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:35.822745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 365/741] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:35.823733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.855227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:35.876295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4354c-4bde-4570-9d12-920c8b2869e1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:35.914781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:35.915411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.915691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.915956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.926431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:35.928002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c83f9864-e0b1-4fcc-96cf-806ce24d4c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:35.941008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:35.942804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 377/742] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6172e-00f6-4d9e-bf17-983834dea0f1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:35.944565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6172e-00f6-4d9e-bf17-983834dea0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:35.949537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6172e-00f6-4d9e-bf17-983834dea0f1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:35.949537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 378/743] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:35.949537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6172e-00f6-4d9e-bf17-983834dea0f1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:35.973311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7c95-aa61-49a4-b5a0-d32c44f03b16 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.016484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.032122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.033159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.033430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.033689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.034367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.034666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.036048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.051304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 366/744] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:36.052147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.086323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6172e-00f6-4d9e-bf17-983834dea0f1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.130066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.130780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.131047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.131314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.131960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.132264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.133670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1c101-07c8-407e-b0f0-2ccc6b00bda0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.152784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 379/745] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:36.152784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6290052-8334-4217-8dee-391238d61b20 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.152784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6290052-8334-4217-8dee-391238d61b20 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.152784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6290052-8334-4217-8dee-391238d61b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.157717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.172050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b6290052-8334-4217-8dee-391238d61b20 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:36.173529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b6290052-8334-4217-8dee-391238d61b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:36.187886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02931-7db8-42e8-9aa7-3cdf40e0f93d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.243546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.244160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.244431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.244854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.245404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.245705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.247537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.255172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 380/746] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 20:00:36.256542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6290052-8334-4217-8dee-391238d61b20 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.275384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 367/747] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:36.275384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.348193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.411403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6290052-8334-4217-8dee-391238d61b20 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.422246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76911e1-8a08-4cbc-ab2c-944aed48a64a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.445756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.452129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.453210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.453702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.454179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.465859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.467860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.483251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.484297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.484773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.485297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:36.486178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:36.487157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:36.488078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:36.488078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:36.488078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:36.494489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 381/748] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:36.496487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.502389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.504859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:36.525222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:36.526493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:36.527520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:36.528850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 368/749] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:36.530003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.623214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1857740-e4eb-4e15-b41a-5e345f52881a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.662471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.663259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.663534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.663803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.665050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=746f454bf6df48378388ac7372961998) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.665360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.666851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.681216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f982-30ec-40c0-b4bf-b3b8c63edfb1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.681617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 382/750] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/role_assignments?user.id=746f454bf6df48378388ac7372961998&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:36.683147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.698693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.733516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.734613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.735141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.735660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.736577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.737133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.738804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.760906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 369/751] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:36.760906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.764049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:36.838437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c02f1-4c76-4cfa-b955-00d2c99b6d1a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.891376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.891931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.892214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.892498 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.893373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.894963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:36.901996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453b78e-c012-4f5b-a91a-637db28a01ef None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:36.912866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 383/752] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:00:36 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:36.914265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:36.974707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:36.975770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:36.976269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:36.976815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:36.977947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:36.978641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:36.980858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.019660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 370/753] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:37.025343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.057163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:37.158495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc82c0-a00b-49a6-9661-de0771932943 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.173736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:37.203092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3901-7851-4cee-9cf7-15e01c0e8388 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.221276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.224149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.224541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.224906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.236865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.239282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.258223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.259154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.259554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.259942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:37.260075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:37.260985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:37.261960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 384/754] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:00:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:37.268940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.287244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.288768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:37.307421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:37.309635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:37.311526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:37.311526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:37.311526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:37.311526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 371/755] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:37.315428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.413996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56cf78-0e7d-4536-bc69-6c83df06593e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.450008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.450719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.450975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.451253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.451941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:37.452128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:37.452281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.453916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cdb3f-b817-4e90-8df6-e09dcca09356 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.474444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 385/756] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:37.475799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88ec1-bda3-4343-8f23-4834523b0e9f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.476083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88ec1-bda3-4343-8f23-4834523b0e9f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.476354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88ec1-bda3-4343-8f23-4834523b0e9f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.481943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 386/757] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:37.483051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c88ec1-bda3-4343-8f23-4834523b0e9f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.485047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777539-7374-4f6b-a3d1-226dd87e789c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.513422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:37.524620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.525273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.525547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.525816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.526472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:37.526773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.528150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92c354-8d1b-4fea-b44e-c07e60c6bb67 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.542052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 372/758] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:37.543434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.543720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.544033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.563896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:37.565157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:37.598047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c88ec1-bda3-4343-8f23-4834523b0e9f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.643952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 373/759] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:37.645073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.649704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.650470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.650748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.651205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.761152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:37.802057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7002fa4-efc5-4ecc-b13e-727e153ecafa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:37.840260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.841834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.850683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:37.851335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:37.851607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:37.851878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:37.867404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:37.868923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:37.896843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:37.898378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:37.900315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 374/760] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:37.904067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:37.919184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.085875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 387/761] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:00:38.095489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.119005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2af63-74b8-496b-9805-55ea48561259 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.149507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.159720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.160391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.161333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.161333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.161741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:38.162049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.163492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.178936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 375/762] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:38.179900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.262729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e63390-4b4e-4183-947c-0cbb9ba30d4c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.298258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba1c9-9083-4b17-b87e-b452b7942b68 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.299533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.311573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.312676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.313179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.313679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.325863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.327829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.337884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.338559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.338765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.339033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.339624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.341197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:38.346303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:38.347322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:38.348227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:38.348227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:38.348227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:38.350722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 388/763] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:38.352016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:38.355536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:38.357864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:38.360462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:38.362286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 376/764] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:38.362286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.419388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.483027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e581d2-be7b-4d6e-a7dd-accdd0e23f03 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.516003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e0e0d-3609-4949-9a2e-01f5e938a986 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.532073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.532786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.533050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.533311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.533968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:38.534270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.535661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.556036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 377/765] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:38.557347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.572354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.573636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.574019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.574382 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.577415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=c5df08926dfe44f3ac00d11414e3513e, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.580079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.605575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 389/766] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:38 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:38.608097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.666498 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.788232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a4f98-535f-4bf2-9fcf-c593d3c163c9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.815042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:38.833554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea160-9c3e-4292-92f0-5793e7135380 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:38.880924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.881819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.882241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.882362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:38.882631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.883019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.883359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.883618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:38.883728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.884190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.886819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f897a89-2c46-4f77-9f9a-b6200adf6369 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.893866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:38.894603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 378/767] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:38.895524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:38.896361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f50a-b37b-4b3d-8ebf-1bc0fee5f172 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.896861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f50a-b37b-4b3d-8ebf-1bc0fee5f172 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.897340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f50a-b37b-4b3d-8ebf-1bc0fee5f172 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.899848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 379/768] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:38.901027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f50a-b37b-4b3d-8ebf-1bc0fee5f172 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-911c96a6-af78-47a7-bce9-26c422a14a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:38.909241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:38.910302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:38.911628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 390/769] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:38.912138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c267c-1a21-4825-9d81-17741371308f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:38.912534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c267c-1a21-4825-9d81-17741371308f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:38.915833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c267c-1a21-4825-9d81-17741371308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:38.933199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-299c267c-1a21-4825-9d81-17741371308f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:38.934849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-299c267c-1a21-4825-9d81-17741371308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:39.070128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 391/770] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:39.071066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c267c-1a21-4825-9d81-17741371308f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:39.086444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f50a-b37b-4b3d-8ebf-1bc0fee5f172 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.120157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:39.161463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.162088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.162363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.162629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.163272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:39.163567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:39.164966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:39.176528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 380/771] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:39.184022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:39.244534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:39.302784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c267c-1a21-4825-9d81-17741371308f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.350807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a152066-f5ca-4c81-8ce5-9a0babf343ad None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.374397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.375406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.375879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.376337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.377627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:39.377943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:39.379407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:39.400294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 392/772] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:39.408140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:39.447702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.448234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.448506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.448863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.450168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] RBAC: Adding query filter params (interface=public, service_id=f1fa891076bd4dd791b5784d663b4947, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:39.450616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:39.452603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:39.472507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 381/773] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/endpoints?service_id=f1fa891076bd4dd791b5784d663b4947&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:39.480304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:39.573801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:39.592714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2da4-d403-421b-91c0-1a591eb4bf40 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.624669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4634fb5-c538-4355-9eee-e9a283ed5db2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.627259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:39.639303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.640015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.640287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.640543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.641321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=8618c519c27c404db3205746c53f58b1) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:39.641623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:39.643064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:39.656796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 393/774] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/role_assignments?user.id=8618c519c27c404db3205746c53f58b1&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:39.656796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:39.692985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.694298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.694906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.695444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.696624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:39.699274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc953ff4-d0fa-4c41-aee8-d32ee30f816e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:39.705847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 382/775] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:39.707528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec765-6205-4d41-8c9b-c014115125cc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.707908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec765-6205-4d41-8c9b-c014115125cc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.708240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ec765-6205-4d41-8c9b-c014115125cc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.714090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 383/776] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:39.716642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.717139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.717474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.755670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:39.760220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:39.840106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d772-6c91-417d-8125-0506605943f0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:39.921974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:39.922278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 384/777] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:39.923630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:39.924144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:39.924654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:39.944931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:39.955156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:39.956163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:39.957140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:39.957787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 394/778] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:39.964513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.110084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:40.118973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361858ae-19bb-41cb-b45e-83a1bd0178aa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:40.162413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:40.163608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:40.163905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:40.164175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:40.164919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:40.165226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:40.166630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:40.177286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 385/779] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:40.185117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.214789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:40.321887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.358534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d78303-d641-4da0-addc-e6da46bc822c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:40.428534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:40.428852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:40.429009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:40.429367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:40.447546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:40.449249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:40.472383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:40.473439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:40.474357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:40.474357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:40.474357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:40.474357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 395/780] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:40.481871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.560289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2453b92-b00c-4cd9-86a9-cdcea17c21a1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:40.601822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:40.602618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:40.602898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:40.603171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:40.603787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:40.605668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:40.621614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:40.624869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:40.626826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 386/781] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/services/network => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:40.636045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.638889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:40.693414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:40.727117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8a76-f762-41aa-be66-273a94b48b37 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:40.812528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:40.813182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:40.813469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:40.813736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:40.814378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:40.814679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:40.816075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:40.837165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 396/782] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:40.840177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af6be-e794-47e9-8632-3dd45c8f08e2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:40.846248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:40.919115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:40.919811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:40.920204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:40.920591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:40.921518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] RBAC: Adding query filter params (name=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:40.921949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:40.923585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:40.935095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 387/783] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:40.940989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.042452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfca6-5718-4593-bc2c-110c335ec460 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.076483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.095158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.095807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.096081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.096347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.106892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.114164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.118215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.129941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc24bc1-50fe-4d53-9511-7351ac932bfd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-91da43c7-d490-4f87-be22-c086878dafee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:41.136989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:41.138278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:41.139463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:41.142292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 397/784] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:41.144262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fea-925b-44bf-87b9-0909d95928fa None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.144704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fea-925b-44bf-87b9-0909d95928fa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.145145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3fea-925b-44bf-87b9-0909d95928fa None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.147710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 398/785] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:41.148832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3fea-925b-44bf-87b9-0909d95928fa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.179343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.180322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.180573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.180964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.181695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] RBAC: Adding query filter params (type=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:41.182079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.183583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc0b1c-3b94-4312-80b6-4802f67f9d3f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.190884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 388/786] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:41.192352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.192783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.193309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.216587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:41.218851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:41.302157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3fea-925b-44bf-87b9-0909d95928fa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.309042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 389/787] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:41.310074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.348557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.349475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.349891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.350664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.351576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:41.352028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.353683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.375862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 399/788] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:41.382825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.444218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.531463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58794-1a03-4822-9456-4d3dd6c43d0d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.541111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.581833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af8215-191e-4f7a-9693-9f900a09d658 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.620045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.621065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.621356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.621627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.633490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.634368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.634811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.635217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.636080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] RBAC: Adding query filter params (interface=public, service_id=32c404005f984e4987ffe4ed8c61aaa9, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:41.636532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.638965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.650742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.656290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.659648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 390/789] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/endpoints?service_id=32c404005f984e4987ffe4ed8c61aaa9&interface=public®ion_id=RegionOne => generated 194 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:41.665826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:41.693029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:41.694065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:41.694974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:41.694974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:41.694974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:41.697294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 400/790] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:41.698850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.791249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb03d-78e2-4bcf-ad92-7536bedf7c5b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.829533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.830343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.830749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.831115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.831561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ffdab-c270-424a-966a-971ff4a901c0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:41.843283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:41.848366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:41.849377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:41.850213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:41.854695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 391/791] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:41.855802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.860621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.873428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:41.881694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:41.884526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:41.885839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:41.886584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:41.887932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:41.891013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:41.898849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 401/792] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:41.900067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:41.984662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4b94-1556-4b5b-b8b7-5a402caf58b4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.036668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.038088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.039103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.039799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.041767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:42.042615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.045564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.070265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 392/793] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:42.076339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.109564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ffbb-b6e8-45aa-8d7e-74d4762d30b2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.214799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.216913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.217684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.218400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.220651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:42.221217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.223702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca42bf-3efd-4dfe-9c7f-8861beebcd66 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.242479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 402/794] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:42.244621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a88b1-3d7d-453c-92eb-d71dcb6b278b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.245238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a88b1-3d7d-453c-92eb-d71dcb6b278b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.246321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:42.246496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a88b1-3d7d-453c-92eb-d71dcb6b278b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.252921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 403/795] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:42.253865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a88b1-3d7d-453c-92eb-d71dcb6b278b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.279956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:42.308440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d205e-5734-4476-974f-e4c174dd629a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.350700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.351335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.351639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.351945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.359340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.360906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-781cfc21-0d91-4ca0-8000-f888dfa72599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:42.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:42.378806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:42.379714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 393/796] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:42.380219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f258-f4c5-4bf5-ba5c-e6cc9e2778fb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.380288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f258-f4c5-4bf5-ba5c-e6cc9e2778fb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.380898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f258-f4c5-4bf5-ba5c-e6cc9e2778fb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.382188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 394/797] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:42.383063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8240c1-5b64-4cbb-a2b5-20c9bd4e06a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.383373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8240c1-5b64-4cbb-a2b5-20c9bd4e06a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.383593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8240c1-5b64-4cbb-a2b5-20c9bd4e06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.395185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a88b1-3d7d-453c-92eb-d71dcb6b278b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.404407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-af8240c1-5b64-4cbb-a2b5-20c9bd4e06a2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:42.405629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-af8240c1-5b64-4cbb-a2b5-20c9bd4e06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:42.435995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.437020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.437482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.437938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.450264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.451725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:42.466527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:42.468043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:42.469206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:42.469206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:42.469206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:42.469206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 404/798] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:42.469206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.512857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 395/799] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:42.512857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.512857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.512857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.532958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:42.534308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:42.565073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:42.611547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22deca02-cf70-4f4f-8391-81861944b0af None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.612264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:42.660783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 396/800] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:42.660783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.697172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.698438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.698853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.699257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.700124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:42.700580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.702290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.731781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 405/801] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:42.737879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.824763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382b4d7-96d3-44a8-a12e-2f57c2889ef7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.872476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.873056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.873607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.873884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.875069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:42.875378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.877332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.893297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 397/802] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:42.894802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:42.905695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2539-7cd9-4272-ae22-267bd194d532 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:42.949238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:42.958568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:42.959417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:42.959794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:42.960852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/746f454bf6df48378388ac7372961998/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:42.967808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=746f454bf6df48378388ac7372961998, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:42.969994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:42.971519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.000776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 406/803] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:42 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/746f454bf6df48378388ac7372961998/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:43.000776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.081710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fcdcd-db63-422e-a5c6-3b53c0dedba6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.137348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.138708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.138992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.140320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.151180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee7e58-442e-4b4c-ae43-3bb29a95658a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.166183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:43.177120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:43.178154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:43.179015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:43.179681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 398/804] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:43.184945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.205864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.206686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.207029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.207410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.215919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.218773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:43.234256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:43.236010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 407/805] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:00:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:43.237656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.300158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.359850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16d49a-090d-4839-b065-d1d08a9a5247 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.366419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.383376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3edceb-f3d1-4fbf-ae0e-563847fd88cb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.413161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.413901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.414247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.414523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.415134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.416504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:43.427727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:43.429498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:43.431980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 399/806] 10.222.0.61 () {56 vars in 1129 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:43.434769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.443861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.444505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.444790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.445066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.445749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:43.447404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.448910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.459310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 408/807] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:43.460219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.581926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425554d-1d64-498c-a371-3f19762af965 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.597611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.630040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.630683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.630959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.631271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.631922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:43.632227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.633694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.640188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 409/808] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:43.646109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.721601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a839-3400-4c41-a0a8-3c59c22fcfb1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.786084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.787442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.787867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.788323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.789283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:43.789737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.791956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.813158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342eef-4354-413e-9c6b-acab5063212b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:43.828592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 400/809] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:43.830497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.858331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:43.859193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:43.859572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:43.859934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:43.869550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.874467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:43.876045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:43.894161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:43.895592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:43.897118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:43.897118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:43.897118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:43.898096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 410/810] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:43.899093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:43.938951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:43.983370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9d6e3-4b1b-4bc8-9f83-ab8141a54d38 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.031597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d0fc-90c9-40e9-a051-2c5c5763bb4e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.040616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.041480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.042016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.042549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.043840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:44.044437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.047543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.060823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 401/811] 10.222.0.61 () {56 vars in 1124 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:44.060823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.081932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.082871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.083502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.083949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.173650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.175944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeea55-5466-4de9-8c98-4875e882faac None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.206420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.219578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf00d7-0baf-4d35-8968-2e35d5c3a937 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.224182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.264988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.265830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.266304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.266580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.267247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:44.267614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.268975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.286200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 402/812] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:44.286200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.321080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 411/813] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:00:44.322471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac59ed-b708-4476-b41a-318c77d345bc None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.322763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac59ed-b708-4476-b41a-318c77d345bc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.323015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac59ed-b708-4476-b41a-318c77d345bc None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.328987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 412/814] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:44.328987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac59ed-b708-4476-b41a-318c77d345bc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.415566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f41d-c9ee-4efc-ab78-e35e343ae304 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.463243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.464023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.464358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.464693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.465755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.466754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac59ed-b708-4476-b41a-318c77d345bc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.467691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.508791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 403/815] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:00:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:44.508791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.510812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.520035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.530238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.530908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.531267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.531672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.541689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.543228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-023eb43d-9a92-4033-8f0f-1a82f716a7e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:44.557683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:44.558752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:44.559963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 413/816] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:00:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:44.561157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.561157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.561304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.595608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:44.596957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:44.726436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e00f-946e-4cf9-880b-1973f72ae814 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.738645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 414/817] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:44.745994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.775091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.776114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.776884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.777615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.795222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.797444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:44.821903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:44.822956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:44.823858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:44.823858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:44.823858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:44.826282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 404/818] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:44.836313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:44.932627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9c68c-3ae0-4bd9-8264-235fcbb1d5f2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:44.942769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.958882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:44.985610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:44.986716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:44.987190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:44.987610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:44.988502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:44.988989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:44.991405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.016555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 415/819] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:00:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:45.025657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.067519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51ed4b-589b-411c-a4a1-fcb42e5aa781 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.131570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.132281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.132662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.133017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.134067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:45.134429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.136796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.159647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 405/820] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:45.159647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.200697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b810d3-0844-451c-9829-9ebf5c4501bd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.252864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.252864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.252864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.252864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.266288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.269353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.288033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e1d9-c63b-4546-86af-a9dee2a8cae5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:45.292229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:45.293429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:45.294706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:45.294706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:45.294706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:45.296359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 416/821] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:45.297784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.318233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:45.332139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:45.344040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.344843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.345182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.345522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] PATH_INFO: `/v3/services/network` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.346179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.347626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-86be0032-13aa-4556-b987-e66ba2af4295 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:45.358050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:45.359735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:45.360982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 406/822] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:45.362077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1f13-8d1a-42c8-b475-207f6a2bb4ad None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.362167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1f13-8d1a-42c8-b475-207f6a2bb4ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.362420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1f13-8d1a-42c8-b475-207f6a2bb4ad None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.370319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 407/823] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:45.370319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f1f13-8d1a-42c8-b475-207f6a2bb4ad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.478186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940c448-e30f-419b-bc22-1f09cbd6e0dd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.534334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.535355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.535836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.536306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.540886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f1f13-8d1a-42c8-b475-207f6a2bb4ad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.546322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.547858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:45.562781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:45.564402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 417/824] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:45.566093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.602515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.603144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.603420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.603689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.604343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:45.604641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.606100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862d46-27ee-4126-90a5-337a2440004e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.619893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 408/825] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:45.621611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.622148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.622314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.642502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:45.643588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:45.686155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:45.692977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:45.704332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73ad7-aa92-45be-a3bc-44b632665c68 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.728802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 409/826] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:45.728802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.748141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.749094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.749535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.749990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.750761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] RBAC: Adding query filter params (name=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:45.751218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.752649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.762194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 418/827] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:45.762194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.872360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa878-d66b-4bbd-9050-85c784b40060 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.881692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ca4e-f2b3-4337-a07a-253745ffd34a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:45.919080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.920032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.920392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.920787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.921620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:45.922022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.922434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:45.923287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:45.923714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:45.923877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.924256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:45.934305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:45.936984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:45.942805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 410/828] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:45.942805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:45.962940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:45.964065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:45.965177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:45.972653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 419/829] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:45.974243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:45.982102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:45.994492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:46.060034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a03a9-9845-47bd-9d0b-ee469b5ff967 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.101642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.102770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.103109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.103390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.104025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] RBAC: Adding query filter params (type=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:46.104325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.105781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.112283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 411/830] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:46.113488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.117819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1612f-4df9-42ef-a6ec-832cdc90c137 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.155719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.156628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.157106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.157379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.158123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:46.158459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.159926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.176792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 420/831] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:45 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:46.176792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.244508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:46.254511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485b2ba-eca3-4903-95f9-cb4dd063d3ac None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.276832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:46.309524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85255e0-b30f-4b04-a5c0-51459b76c6d2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.310827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.312067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.313633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.314204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.315130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:46.315650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.317347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.335792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 412/832] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:46.337340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.350945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.351581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.351855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.352123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.365100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:46.484300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442247f-7751-4a3b-9f9b-61296670c6e9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:46.496537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:46.497985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:00:46.499533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:46.503229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 421/833] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:46.504647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.526269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.527031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.527444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.527891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.529277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.531419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.558401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 413/834] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:00:46 2022] POST /identity/v3/endpoints => generated 337 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:46.559973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.597352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:46.711304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b4bdd-bd61-4ab5-b913-ef0c36856ca0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.785797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.786424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.786722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.786988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/8618c519c27c404db3205746c53f58b1/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.787871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:46.791879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65ba56-25eb-42f8-a6a4-941e4daf73f6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:46.817519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=8618c519c27c404db3205746c53f58b1, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.819387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.841911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 422/835] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:00:46 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/8618c519c27c404db3205746c53f58b1/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:00:46.847705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:46.848358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.848636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.848961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.849785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:46.850475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:46.852101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923280-8337-49a3-8331-ca86f2f9dc3f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:46.863518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 414/836] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:46.869574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:46.946580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07717d-93ff-4f46-b417-8aa4b3e149ea None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.947011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07717d-93ff-4f46-b417-8aa4b3e149ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.947473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07717d-93ff-4f46-b417-8aa4b3e149ea None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.957896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 415/837] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:46.960604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:46.961114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:46.961550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:46.994458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:46.996795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:47.039429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934707-f0e4-4ebb-b9db-d5a30db17c08 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.091768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.092833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.093332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.093703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.110812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.113051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.113202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:47.121634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 416/838] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:47.129989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:47.130978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:47.131917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:47.131917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:47.131917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:47.134084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 423/839] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:47.142830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.281174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928c25f-e81e-42cf-a6ad-f5f2c267aebf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.321175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.321703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.321970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.322236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.322880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:47.323172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.324524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.337257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 417/840] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:47.342950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.387589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:47.445537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.511812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203c26d-294c-41f3-a332-fc07b60fd43c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.526073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:47.575313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782714c-8136-417f-8513-72b5a0d33fb1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.579861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.580896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.581367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.581795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.595863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.598551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:47.618303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:47.619329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 20:00:47.620383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:47.628909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 424/841] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:47.629110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.629110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.629110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.629110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.629425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.629425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.633267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:47.639192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:47.640238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:47.641148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:47.643979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 418/842] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:47.653821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.746457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:47.757270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177375-3f8f-4ab5-9ff5-48cf7eb1e515 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.795100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.796355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.796801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.797108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.798126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:47.798510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.798978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b59d7-1db6-4b43-9c77-05d5d921deb7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.799963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.824811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 425/843] 10.222.0.61 () {56 vars in 1135 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:47.833035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.842246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:47.856973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:47.857759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:47.858135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:47.858574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:47.859553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:47.860041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:47.861864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:47.872584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 419/844] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:47.873554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:47.961965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285c726-48fe-489c-947d-cbd47ad3233f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:47.983089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68799ab-9fb3-4ce9-a236-d81058f45518 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:48.009008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:48.010017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.010514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.011108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.029796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:48.030470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.031050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.031417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.032934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:48.033329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:48.035843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:48.037416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:48.049325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 420/845] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:48.103942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:48.106287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:48.234460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 426/846] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:00:48.242392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:48.309925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:48.374944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9d75e-3462-4ba6-a571-a17d34ae3168 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:48.418821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:48.420056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.421544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.422301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.438502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:48.441045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5809342b-1676-4366-a069-5d010ea42646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:48.461967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:48.463237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:48.464555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:48.464555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:48.464555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:48.467221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 421/847] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:48.473342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:48.537689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:48.545070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094943a-7a36-41b1-9754-28d97c86df38 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.545396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094943a-7a36-41b1-9754-28d97c86df38 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.545660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094943a-7a36-41b1-9754-28d97c86df38 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.547308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 422/848] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:48.552718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.553030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.553303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.574217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:48.575501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:48.604966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6afc9-7709-4208-bf21-471a962c2d9d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:48.650637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:48.651264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.651543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.651813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.652466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:48.652798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:48.654594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:48.677211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 423/849] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:48.681012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 427/850] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:48.692821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:48.725151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:48.812164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e53be0-1a18-4923-a47b-1027e3eedf5e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:48.849450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:48.850101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:48.850370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:48.850629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:48.859152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:48.861860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:48.882079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:48.883198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:48.884093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:48.885282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 424/851] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:48.893542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:48.964546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:49.025263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590675-94c9-4255-8ea2-cfb64f54b3ec None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.040919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:49.074760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.075467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.075803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.076057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.076708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:49.077042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:49.079115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:49.100712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 428/852] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:49.101261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:49.104704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:49.113301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debc90c-8407-4398-86e0-20dd8ad4ee72 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.168965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.170258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.170568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.170988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.172143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:49.174403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f75a1a14-6141-4731-903f-de9d2fbc9e75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:49.191901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:49.193032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:49.193953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:49.195144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 425/853] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Aug 29 20:00:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:49.196590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aa8e-decd-452c-ae60-ab379b6f6e0c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.197090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aa8e-decd-452c-ae60-ab379b6f6e0c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.197462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2aa8e-decd-452c-ae60-ab379b6f6e0c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.200190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 426/854] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:49.201270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2aa8e-decd-452c-ae60-ab379b6f6e0c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:49.254359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895941c9-4037-45dc-95fb-b70d96b83d9b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.300938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.301845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.302298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.302877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.303787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=746f454bf6df48378388ac7372961998) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:49.304256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:49.306630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a4d6-227c-422a-b0b1-d54f06b0dddd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:49.332850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 429/855] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:49 2022] GET /identity/v3/role_assignments?user.id=746f454bf6df48378388ac7372961998&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:49.332850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.332850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.332850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.355602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:49.357276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:49.359593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2aa8e-decd-452c-ae60-ab379b6f6e0c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.397568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:49.413038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.413726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.414007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.414282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.416363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:49.416674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:49.418204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:49.424448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 427/856] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:49.431477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:49.474839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:49.477518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 430/857] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:49.584819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b558a7-e851-4bf5-9cde-dc775cb83183 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.639849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.641174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.641653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.642091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.642917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:49.643474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:49.645690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:49.651920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 428/858] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:49.780695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:49.909107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a49ac-c4a6-4f7b-af81-c8a83bbb48e3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:49.955844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:49.956957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:49.957470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:49.957865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:49.970841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:49.975892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:49.976923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:49.977772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 431/859] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:00:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:49.985360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:50.090275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:50.116715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771f50-f7b5-448d-a951-bfee7af1159b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:50.155803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:50.156422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:50.156697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:50.156994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:50.157666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:50.157967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:50.159399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b8abb-aef4-4751-a23d-2960e4ac2b04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:50.168689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 429/860] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:50.174718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:50.209971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:50.305394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce36d1d-0eb8-4386-a2a6-cbff11e80a60 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:50.352988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3b717-3902-46f0-830e-217db805810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:50.353999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b717-3902-46f0-830e-217db805810b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:50.354499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b717-3902-46f0-830e-217db805810b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:50.354957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b717-3902-46f0-830e-217db805810b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:50.366606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a092-848f-4d7f-8c3b-c8c95a4889b5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:50.366927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a092-848f-4d7f-8c3b-c8c95a4889b5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:50.367135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a092-848f-4d7f-8c3b-c8c95a4889b5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:50.368769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 430/861] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:50.370975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3b717-3902-46f0-830e-217db805810b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:50.373370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3b717-3902-46f0-830e-217db805810b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:50.374485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:50.374767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:50.375036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-25f3b717-3902-46f0-830e-217db805810b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:50.391979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:50.393350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:50.394341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:50.394341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:50.394341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:50.395812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:50.396618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 432/862] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:50.400866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:50.402646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3b717-3902-46f0-830e-217db805810b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:50.559746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:50.564079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 431/863] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:50.641611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3b717-3902-46f0-830e-217db805810b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:50.732789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:50.733502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:50.733853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:50.734124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:50.734792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:50.735095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:50.736484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:50.762496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 433/864] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:50.775724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:50.923741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:50.958656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d1573-4d74-4b0c-b04d-a67820609682 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:51.004808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474473-9482-4244-81d2-a76633127a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:51.005455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474473-9482-4244-81d2-a76633127a55 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.005806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474473-9482-4244-81d2-a76633127a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.006121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474473-9482-4244-81d2-a76633127a55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.015510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474473-9482-4244-81d2-a76633127a55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:51.017134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474473-9482-4244-81d2-a76633127a55 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-89474473-9482-4244-81d2-a76633127a55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:51.030614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:51.031635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:51.032573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 432/865] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:00:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:51.033469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:51.039585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474473-9482-4244-81d2-a76633127a55 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:51.168674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f790ccc-c7df-414a-a0f1-c7a39a988917 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:51.187063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474473-9482-4244-81d2-a76633127a55 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:51.221346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:51.222097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.222263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.222505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.223430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:51.225893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:51.230705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:51.231896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:51.232346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.232856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.233392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.234623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:51.235017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:51.236704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece5322-cb5a-447d-a686-309a2d63da70 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:51.249083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:51.257329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 434/866] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:00:51 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:51.272140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 433/867] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:00:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:51.281103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:51.429684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd236686-2b6f-40db-87b4-9669beaade69 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:51.468027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:51.469032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.469603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.470066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.537709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:51.551893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:51.554773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:51.683205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 435/868] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:51 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:00:51.689426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6e9e-ab3c-43fa-b7e8-39248d9e25a7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.689794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:51.690227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6e9e-ab3c-43fa-b7e8-39248d9e25a7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.690692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf6e9e-ab3c-43fa-b7e8-39248d9e25a7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.692540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 434/869] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:51.701364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.702771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.704161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.730876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:51.732681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:51.811874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 435/870] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:51.819813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:51.830700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c7de5-4e87-45e1-b6fd-02b3d943a07d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:51.873582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:51.874586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.875108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.875569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.890864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:51.892348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c264db9c-ade8-4318-aa82-363979e0867e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:51.909134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:51.910417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:51.911357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:51.911357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:51.911357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:51.911357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 436/871] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:51.916030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:51.941796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e614ed-add6-4134-a885-1df5589f2cca None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.942249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e614ed-add6-4134-a885-1df5589f2cca None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.942712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e614ed-add6-4134-a885-1df5589f2cca None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.946905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 437/872] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:51.954915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:51.955358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:51.955775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:51.986856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:51.988861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:52.046335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3e227-5049-4b9e-8e47-fb5e3724dc58 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.072274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 438/873] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:00:52.081263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.092102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.093539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.094391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.094846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.095313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.096414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:52.096559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.098115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.111746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 436/874] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:52.118025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.199373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.236454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c845-7f8b-4174-82aa-a834435784c2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.258775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666e226-387d-44cc-9c71-38e9036611f4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.291330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.291998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.292368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.292647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.293287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.296483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.300640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.301659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.302153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.302620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:52.308806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:52.310123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:52.310985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:52.316828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 439/875] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:52.319383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.320665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.323291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:52.342155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:52.343724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:52.346099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:52.348852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 437/876] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:00:52.350971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.414485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.471224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edf646-f11e-4899-a1ec-85c40d89f508 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.487064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97906a5-9e16-4fc5-8df2-7419a214b814 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.518006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.518533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.518914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.519178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.519825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:52.520124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.521532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.526462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 440/877] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:52.527258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.531257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.541262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.541891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.542199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.542870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.544051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:52.544051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.545779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.559531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 438/878] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:52.560405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.653941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6449a-69df-41da-a1a5-8012eb2cb382 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.686169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeecc1-a04c-4ae3-920c-48d5804e245d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.694580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.706577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.707664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.708126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.708595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.709424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.710916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.730018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.730633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.730998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.731391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.732318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:52.732629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.734136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2b23-614b-4e16-bd1b-615e59cf2bfb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.736840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 441/879] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:00:52 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:52.736840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:52.746058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 439/880] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:52.836266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:52.901005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47479e8b-91e1-4156-a401-5ba26c23cf5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:52.944199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:52.944977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:52.945324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:52.945622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:52.946453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=8618c519c27c404db3205746c53f58b1) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:52.946788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:52.948450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92079a8f-0266-4f63-8787-a2c6d462fb6c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:52.957236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 442/881] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:52 2022] GET /identity/v3/role_assignments?user.id=8618c519c27c404db3205746c53f58b1&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:53.428700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7631454-ef93-4677-9db2-094a5aa9e156 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:53.429493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7631454-ef93-4677-9db2-094a5aa9e156 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:53.429493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7631454-ef93-4677-9db2-094a5aa9e156 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:53.431147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 440/882] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:53.437836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:53.438466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:53.438555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:53.460808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:53.462254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:53.552568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 443/883] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:53.848592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7631454-ef93-4677-9db2-094a5aa9e156 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:53.978393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7631454-ef93-4677-9db2-094a5aa9e156 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:54.016549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:54.017265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.017537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.017881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.018540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:54.020070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:54.030648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:54.031823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:54.033722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 441/884] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:54.040149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:54.135781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:54.207663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84d604-aa8e-4b6d-bf5c-95d8db40bee5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:54.252892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:54.253545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.253861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.254180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.254980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:54.255280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:54.257192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:54.264050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 444/885] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:54.269911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:54.315543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:54.406200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83fae-75e4-4550-82b4-ff26fb75932c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:54.444360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:54.445794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.446307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.446753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.447573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:54.448050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:54.449843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:54.456383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 442/886] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:54.464783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:54.594834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb31c-6a56-45f9-bfb2-75111484dc14 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:54.615770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:54.638630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:54.639452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.639789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.640112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.641154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] RBAC: Adding query filter params (interface=public, service_id=93522301f7ff450e8ad73627e76f010c, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:54.641615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:54.643221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8719bec-1e1c-4b8e-b85e-b72bcb1ec059 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:54.653340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 445/887] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:00:54 2022] GET /identity/v3/endpoints?service_id=93522301f7ff450e8ad73627e76f010c&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:54.663069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:54.807464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:54.813533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81755d7b-7f54-413e-9818-402dba3919d8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:54.857563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:54.858707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.859273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.859757 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.860620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:54.862377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2af57-ce0a-4ca8-97aa-c67c2b25e7a3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:54.862816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2796ba-c513-4455-a917-e338c8e4ea3d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.863143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2796ba-c513-4455-a917-e338c8e4ea3d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.863471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2796ba-c513-4455-a917-e338c8e4ea3d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.865431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 446/888] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:54.871044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 443/889] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:00:54 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:00:54.872413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297f0-fc74-4e1c-8f1b-53158029ec7f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:54.873085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297f0-fc74-4e1c-8f1b-53158029ec7f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:54.873730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297f0-fc74-4e1c-8f1b-53158029ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:54.897149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-15c297f0-fc74-4e1c-8f1b-53158029ec7f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:54.899153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-15c297f0-fc74-4e1c-8f1b-53158029ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:54.994207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 447/890] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:00:55.129453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07518f6-0a65-4204-9b9b-bb3ce700cf90 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.130218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07518f6-0a65-4204-9b9b-bb3ce700cf90 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.130865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07518f6-0a65-4204-9b9b-bb3ce700cf90 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.133442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 444/891] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:55.140599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.141066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.141459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.162198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:55.164054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:55.222271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6928d6-ba6b-4b57-bf70-cc5fb286a904 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.222609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6928d6-ba6b-4b57-bf70-cc5fb286a904 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.222868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6928d6-ba6b-4b57-bf70-cc5fb286a904 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.224516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 445/892] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:55.230322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.230649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.230970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.254602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:55.256991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:55.260957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 448/893] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:55.310583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:55.369097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 446/894] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:00:55.381268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:55.452287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34249-bc3c-4b9d-b30d-54b9d70a6f9c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:55.494323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:55.495940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.496429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.496911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.497747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:55.499287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:55.525026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 449/895] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:00:55 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:00:55.581709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:55.671089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:55.739128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:55.754086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5904ea3-b528-466b-8670-f3391dac44fa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:55.822099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:55.823071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.823560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.824039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.826019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:55.832063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57688c-39bd-4c39-b03b-5cc4432ccaf4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:55.839382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:00:55.845090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:55.846230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:55.847242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 447/896] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:00:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:55.854269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:55.912536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:55.913779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:55.914291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:55.914825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:55.915627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:55.917560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:55.930902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:55.932133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:00:55.933640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:55.937302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 450/897] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Aug 29 20:00:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:55.947721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.016798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccad55-0667-4888-aaaa-a9f93499821e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.061974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.062790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.063064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.063328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.064039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.064342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.066030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.077984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 448/898] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:00:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:56.086305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.105809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:56.118402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c3bd3-b22a-46cd-97c3-ad6a8a395671 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.188331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.189481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.190058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.190484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.191519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.191972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.193750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.204195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 451/899] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:56.206134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.244974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:56.253069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b26bb-7b7a-4e8e-b99c-783832e6ee8e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.304430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.305608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.306115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.306635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.324850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.327336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:56.346210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:56.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:56.348450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:56.348450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:56.348450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:56.351222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf90af3-e6e7-49bf-8680-9b562bda71ac None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.351544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 449/900] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:56.359905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.412268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.413140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.413506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.413903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.414606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.414978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.416536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.427989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 452/901] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:56.429114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.430024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:56.468246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6c54a-7f13-47bf-8e09-b3c295ae976e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.505841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.506753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.506865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.507071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.508118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.508314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.509736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.528452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 450/902] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:56.529288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.558050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcadcce-c884-4a6c-82b5-aa237af1c324 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:56.611630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.612905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.613411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.614737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.615670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] RBAC: Adding query filter params (interface=public, service_id=636ef25a7a8546f083faa7c6a8bd06b9, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.616177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.617817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.630820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 453/903] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/endpoints?service_id=636ef25a7a8546f083faa7c6a8bd06b9&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:56.632619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.653901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78c01-0155-4e28-bc67-a29a43a67230 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.689381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:56.708776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.709919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.710444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.710951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.720287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.722282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:00:56.737205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:56.738316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:00:56.739253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:56.746924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 451/904] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:56.748136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.769749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4631c-6209-4256-885b-e5c2c4f39c74 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.818466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.819555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.820157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.820677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.821786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.824363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.845147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 454/905] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:00:56.874364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fabacb-e8ab-42d0-b6e8-d19e170189e7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:56.916239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:56.917254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:56.917743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:56.918473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:56.919992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:56.920521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:56.922205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26fb08-36fb-499d-97c0-688ead97f335 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:56.944215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 452/906] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:56.953823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:56.999073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:57.105486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8b1a-7213-4e71-a1c6-53895c0ca25c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:57.128860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614887e-8b37-496f-899f-9ea4a60fe377 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.129154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614887e-8b37-496f-899f-9ea4a60fe377 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.129387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614887e-8b37-496f-899f-9ea4a60fe377 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.131037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 453/907] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:57.138485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.139148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.139634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.148209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:57.149166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.149617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.150077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.160617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:57.162055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:57.216798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:57.244502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:57.246597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:57.270414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:57.284516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 454/908] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:00:57.425282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 455/909] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:00:56 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:00:57.435629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:57.562760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:57.591583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a471-2104-404d-93ef-4ea3ba3b7119 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:57.633156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:57.633905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.634181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.634447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.647012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:57.649093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:00:57.670101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:57.671581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:00:57.672529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:00:57.672529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:00:57.672529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:57.672529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 455/910] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:57.680704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:57.711117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:57.775897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0293844-123e-4e7a-b6ba-c386f9f38334 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:57.818129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:57.825395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e3c9-364d-45cf-874a-dd6fdcfb79a6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:57.842420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:57.843470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.843931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.844397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.845417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:57.847884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-25857d0c-b1ae-4f5c-bec5-770429bc7a83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:57.865845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:57.868082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:00:57.869991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 456/911] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:57.871947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d117-1b9b-4a44-9bf8-ef37bf18bc53 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.871947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d117-1b9b-4a44-9bf8-ef37bf18bc53 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.871947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d117-1b9b-4a44-9bf8-ef37bf18bc53 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.873471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 457/912] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:57.874751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d117-1b9b-4a44-9bf8-ef37bf18bc53 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:57.903904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:57.905979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.906716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.907442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.909516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:57.910338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:57.913599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573ea17-64e3-41da-b18a-301e03b33b79 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:57.938703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 456/913] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:57.942909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799420c-f685-4744-b3a1-174490f66677 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:57.943727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799420c-f685-4744-b3a1-174490f66677 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:57.944335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799420c-f685-4744-b3a1-174490f66677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:57.973773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2799420c-f685-4744-b3a1-174490f66677 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:57.975091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2799420c-f685-4744-b3a1-174490f66677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:58.040927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d117-1b9b-4a44-9bf8-ef37bf18bc53 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.075196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 457/914] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:58.078255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799420c-f685-4744-b3a1-174490f66677 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.104187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.104187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.104187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.104187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.104867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:58.104945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:58.104945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.112785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.114211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 458/915] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:58.122325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.194731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:58.246233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799420c-f685-4744-b3a1-174490f66677 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.292577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb55528-d9e6-4727-886d-1cb5a661cc8a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.302015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.302894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.303253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.303657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.315301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.317211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:00:58.334141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:58.335740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:58.336931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 458/916] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:58.344901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.364399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.365451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.366379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.367032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.368299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:58.368928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.371876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.379563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 459/917] 10.222.0.61 () {56 vars in 1114 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:58.385502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.468130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:58.508429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87b797-9742-49b3-97ae-8e49ab5c2390 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.527555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b7ee-0735-4ad8-a31f-b1ee3e5d5014 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.549268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:58.560704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.561531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.562445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.562445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.563413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:58.563862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.565727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.585550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.586256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 459/918] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:58.587367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.592510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.593026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.593324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.594115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.595558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.627915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 460/919] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:00:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:00:58.629506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.752204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd5684-4cc8-40fe-aaf0-c2d76677b27e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.799408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:58.828057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.828585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca7-ce25-4655-a494-29cbdbcc307d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:58.829048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.829451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.829826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.830767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.833231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:00:58.846242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:00:58.848268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:00:58.849786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 460/920] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:00:58.856619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:58.889417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:58.890827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:58.891405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:58.891997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:58.892927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] RBAC: Adding query filter params (role.id=0c116a921bbf4d408872c84db699c0f8, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=8618c519c27c404db3205746c53f58b1) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:58.893384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:58.895841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:58.905662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 461/921] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/role_assignments?user.id=8618c519c27c404db3205746c53f58b1&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=0c116a921bbf4d408872c84db699c0f8 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:58.990545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2b48-0d32-464c-9fd5-259daac72736 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:59.043094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:59.043788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.044133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.044762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.045618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:59.046000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:59.047832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:59.055607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 461/922] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:00:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:59.064630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:59.133217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:59.236428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2bf92-ff22-4f09-8f09-e097da573b7b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:59.286174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:59.287261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.287848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.288471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.289637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:59.290216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:59.292121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af83fb-7110-40fc-b656-11241f4cfaaf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:59.300215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 462/923] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:00:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:00:59.309395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:59.414150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0cf0-c7df-4563-9fcb-c1928216ec96 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.414853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0cf0-c7df-4563-9fcb-c1928216ec96 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.415326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0cf0-c7df-4563-9fcb-c1928216ec96 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.417274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 463/924] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:00:59.420957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:59.424564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.425188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.425774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.457373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:00:59.459966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:00:59.511786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e98e94-e52b-473c-a295-91c06d980cfe None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:59.564046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:59.564526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.565155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.565313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.568771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] RBAC: Adding query filter params (interface=public, service_id=f28753454013487e84cdba54579a29d6, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:00:59.568771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:59.568771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:59.576569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 462/925] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:00:59 2022] GET /identity/v3/endpoints?service_id=f28753454013487e84cdba54579a29d6&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:00:59.589849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:59.604771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 464/926] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:00:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:00:59.726357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd967977-0a69-49c5-8282-87af8f9b3bc2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:00:59.748645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:00:59.764695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:00:59.765789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:00:59.765789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:00:59.766009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:00:59.766452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:00:59.767823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:00:59.774872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 463/927] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:00:59 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:00:59.924121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:00:59.968726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:00.113785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e5c2b-a573-4f44-b744-4b67f20885a4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:00.164433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:00.165453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:00.165846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:00.166185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:00.166994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:00.169132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:00.180580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:00.182450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:00.184454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 465/928] 10.222.0.61 () {56 vars in 1132 bytes} [Mon Aug 29 20:00:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:00.188212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:00.309288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0202d-9e34-4a8c-b286-5e86460604d0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:00.348443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:00.349554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:00.350081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:00.350545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:00.351386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:00.351884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:00.353482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:00.359711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 464/929] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:01:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:00.365837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:00.476066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:00.488181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7e9f7-912d-4deb-bb6c-227192905ab4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:00.529766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:00.530426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:00.530745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:00.531009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:00.531654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:00.532033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:00.533546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffecfa-d749-496d-a11f-4444a8bcca0c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:00.540963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 466/930] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:01:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:00.548121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:00.611705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:00.667663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d79b7-0bf8-47af-b8de-9d2162b370fc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:00.710217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:00.711425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:00.711714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:00.711986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:00.712715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:00.714277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc9860-43fe-4584-b35b-c229b87b4e25 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:00.744017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 465/931] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:01:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:01.345853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0328-fe0a-45df-9a33-3b542ae0321b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:01.346750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0328-fe0a-45df-9a33-3b542ae0321b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:01.346750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0328-fe0a-45df-9a33-3b542ae0321b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:01.348124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 467/932] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:01:01.353849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae531-88fa-443f-9c96-d02e8f4ffeac None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:01.354537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae531-88fa-443f-9c96-d02e8f4ffeac None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:01.354537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae531-88fa-443f-9c96-d02e8f4ffeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:01.373613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-103ae531-88fa-443f-9c96-d02e8f4ffeac None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:01.374800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-103ae531-88fa-443f-9c96-d02e8f4ffeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:01.452922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 466/933] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:01.574040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6aa6-6203-440e-a2aa-d0747d139b52 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:01.575332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6aa6-6203-440e-a2aa-d0747d139b52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:01.576096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6aa6-6203-440e-a2aa-d0747d139b52 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:01.579453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 468/934] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:01.585960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:01.586631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:01.587100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:01.617652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:01.619897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:01.652587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:01.725088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 467/935] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:01.747345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6aa6-6203-440e-a2aa-d0747d139b52 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:01.881326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6aa6-6203-440e-a2aa-d0747d139b52 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:01.920652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:01.921312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:01.921589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:01.921857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:01.922510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:01.923962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:01.926652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING keystone.server.flask.common [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 20:01:01.947554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.sql.core [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:01:01.947554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:01:01.947554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [parameters: {'id': '760aa91761654368a1d9e1f0a724a482', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:01:01.947554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 760aa91761654368a1d9e1f0a724a482.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 760aa91761654368a1d9e1f0a724a482. Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:01:01.965655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 20:01:01.966752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application yield resource Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise self.value Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application session.commit() Aug 29 20:01:01.967738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:01:01.969404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:01:01.970811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:01:01.971968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [parameters: {'id': '760aa91761654368a1d9e1f0a724a482', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:01.974482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:01.976033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 760aa91761654368a1d9e1f0a724a482. Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:01.981375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 469/936] 10.222.0.61 () {60 vars in 1140 bytes} [Mon Aug 29 20:01:01 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:01.982838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.023875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.047743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:02.132136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf4e48-efbd-4b83-9ab8-91b49eb189e5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.179153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.180571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.181384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.181905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.191912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:02.194354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:02.213996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:02.215099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:02.216238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 468/937] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:02.222166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.224388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94c1e-78f5-4728-b017-47240cd0016b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.254331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:02.269200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.269846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.270126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.270406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.288577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-008319e5-3940-44a3-afc8-becee3982a69 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:02.295332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:02.296950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:02.298534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:02.300953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 470/938] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:02.303789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81f3a-34f2-4608-bebd-30913ec8db3d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.305132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81f3a-34f2-4608-bebd-30913ec8db3d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.305487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81f3a-34f2-4608-bebd-30913ec8db3d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.312904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 471/939] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:02.312904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f81f3a-34f2-4608-bebd-30913ec8db3d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.372022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d90e4-c68e-4560-a671-3570794f365f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.412056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:02.417595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.418812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.419310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.419817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.420788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:02.421272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:02.422995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aa81b-4dff-42f0-9e49-78a5cbcbac6a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:02.447103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 469/940] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:02.448863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.449414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.449867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.454590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f81f3a-34f2-4608-bebd-30913ec8db3d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.471997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:02.473963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:02.505252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.505913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.506185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.506452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.507155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:02.507445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:02.509883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:02.524791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 472/941] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:02.530080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.577691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 470/942] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:02.685333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd895d9-f0f7-4a9a-9908-02a6fc5ceae5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.722830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:02.731329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.732534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.733571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.733571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.750529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:02.752439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:02.771942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:02.773289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:02.774287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:02.774287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:02.774287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:02.774287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 473/943] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:02.781975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.803281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:02.898242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:02.922521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7274-1bbb-4c3f-a1f2-153a54433f0f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:02.982993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:02.983970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:02.984428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:02.984918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:02.986048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:02.986538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:02.989144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c32aa0-40f8-4f83-b6df-6d626398db73 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.010870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 471/944] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:03.013134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3abd-749b-414d-af2f-4acd27df723a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.013612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3abd-749b-414d-af2f-4acd27df723a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.014071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3abd-749b-414d-af2f-4acd27df723a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.017503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 472/945] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:03.021166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3abd-749b-414d-af2f-4acd27df723a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.062294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155500c-0d44-44ed-8f6a-2f77829b6717 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.118621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.119268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.119268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.119448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.120395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.121941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.131930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e7110ba0-85ec-45d0-b288-4ebe5cd5c379 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:03.139085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:03.140306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:03.149924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 474/946] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:01:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:03.151516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.151516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.151516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.170426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3abd-749b-414d-af2f-4acd27df723a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.177094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:03.178734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:03.216270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.217339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.217611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.217888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.227766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.229268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.247311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:03.248211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:03.249857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 473/947] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:03.251180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.288815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 475/948] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:03.288815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.414751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b0fa-bed7-4af3-a4bc-bce2cf8dff6c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.448867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989420a5-fd5e-4ab9-8b04-9c0843c1e272 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.450376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.457105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.457853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.458177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.458450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.459116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:03.459421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.460817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.467373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 474/949] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:03.477972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.512179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.513150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.513577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.514028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.515067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:03.515705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.517529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.551851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 476/950] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:03.560812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.612254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.649751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c46cc-810d-4c51-a49a-9b29b77a3d37 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.710731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.712169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.712628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.713197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.715013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:03.715561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.719083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.734128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1e020-deef-4399-8322-04744c287018 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.736617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 475/951] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:03.738223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.782672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.783268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.783743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.784025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.797025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.798500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:03.815900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:03.816991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:03.818040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:03.818040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:03.818040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:03.818040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 477/952] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:03.818040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:03.839448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.912423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4f954-f768-4de1-9d80-1d3460f19dc9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.944523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:03.969602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425335-3bd8-4358-8174-983319915b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:03.970086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c31df-4964-468c-bfb5-65d42f9333c5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:03.970240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425335-3bd8-4358-8174-983319915b2c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:03.970513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425335-3bd8-4358-8174-983319915b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:03.970773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96425335-3bd8-4358-8174-983319915b2c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:03.971353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425335-3bd8-4358-8174-983319915b2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:03.972725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96425335-3bd8-4358-8174-983319915b2c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-96425335-3bd8-4358-8174-983319915b2c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:03.982444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:03.983650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:03.984568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 476/953] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:03.985515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425335-3bd8-4358-8174-983319915b2c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.025314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.025957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.026271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.026564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.027450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.029221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.059821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 478/954] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:01:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:04.060601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.141864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96425335-3bd8-4358-8174-983319915b2c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.186455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:04.215243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.216016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.216361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.216694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.217465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:04.217830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.219534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.229018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdf4b5-0779-4e7e-93e9-d4c98f53cc59 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.240198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 477/955] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:04.246402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.294008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.295128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.295128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.295343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.296013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:04.296318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.297806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.309375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 479/956] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:04.310659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.328167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:04.422947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab816-3781-49d6-bf07-2e68338c2884 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.496307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa596-afdd-4328-b621-bfa7ee9ff6c2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.501597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.502630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.503142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.503668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.516973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.519085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:04.539649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:04.541448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:04.544026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:04.549301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 478/957] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:04.551440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.575003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.576452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.577199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.578249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.580126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:04.580906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.584076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.594844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 480/958] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:04.626593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:04.707573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c231b3-7844-4d7d-8c1c-294882f346f7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.749790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.750409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.750671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.750999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.751704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:04.751996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.753465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fe073-74ad-4325-9207-788341c95a03 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.766782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 479/959] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:04.773153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:04.855212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:04.891721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ac849-ca68-4174-a45a-672ee46e1016 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:04.908254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0f6f-e784-41b3-9afe-a218e5f934a7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.908588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0f6f-e784-41b3-9afe-a218e5f934a7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.908826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f0f6f-e784-41b3-9afe-a218e5f934a7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.914087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 480/960] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:04.915748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.916094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.916433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.929329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26505b-eb63-4595-813b-09012573703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:04.930012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26505b-eb63-4595-813b-09012573703b None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:04.930293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26505b-eb63-4595-813b-09012573703b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:04.930569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26505b-eb63-4595-813b-09012573703b None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/8618c519c27c404db3205746c53f58b1/roles/0c116a921bbf4d408872c84db699c0f8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:04.932988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26505b-eb63-4595-813b-09012573703b None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=8618c519c27c404db3205746c53f58b1, role_id=0c116a921bbf4d408872c84db699c0f8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:04.934650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26505b-eb63-4595-813b-09012573703b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:04.937012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:04.939259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:04.953457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 481/961] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:01:04 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/8618c519c27c404db3205746c53f58b1/roles/0c116a921bbf4d408872c84db699c0f8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:01:05.040431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 481/962] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:05.322919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26505b-eb63-4595-813b-09012573703b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:05.445211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26505b-eb63-4595-813b-09012573703b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:05.485443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:05.486071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:05.486398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:05.486670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:05.487334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:05.488894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:05.493933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:05.504229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.sql.core [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:01:05.504229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:01:05.504229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [parameters: {'user_id': '3c6d4bdc65f442dc9e96d120abc9a571', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:01:05.504229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 20:01:05.512969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:01:05.513888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application yield resource Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise self.value Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application session.commit() Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 20:01:05.514865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.flush() Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application compat.raise_( Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 20:01:05.515770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 20:01:05.516942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 20:01:05.518733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [parameters: {'user_id': '3c6d4bdc65f442dc9e96d120abc9a571', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:05.520784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 20:01:05.522672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:05.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 482/963] 10.222.0.61 () {60 vars in 1131 bytes} [Mon Aug 29 20:01:05 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:05.530628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:05.553634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:05.634256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43a7b-2b4a-48a6-9841-97527e74d6ad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:05.689837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:05.690490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:05.690758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:05.691021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:05.699366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:05.700908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-936ffb60-0c7c-493d-a3da-dc567b7a0034 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:05.713375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:05.715644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 20:01:05.717853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:05.719157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 482/964] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:05.722313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:05.844222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9d5a0-e38a-43f3-a97a-703cb220e314 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:05.882555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:05.883171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:05.883441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:05.883706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:05.884464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:05.884703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:05.886444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeb262-f787-4e57-8afc-4e280b72f6a1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:05.932903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 483/965] 10.222.0.61 () {56 vars in 1101 bytes} [Mon Aug 29 20:01:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:06.343268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf8ac-1cf7-48d5-88d8-c82e45da4198 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:06.343653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf8ac-1cf7-48d5-88d8-c82e45da4198 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:06.343774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadf8ac-1cf7-48d5-88d8-c82e45da4198 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:06.345354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 483/966] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:06.350758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449593-4d1f-45fe-b190-20533762fa81 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:06.351011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449593-4d1f-45fe-b190-20533762fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:06.351317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449593-4d1f-45fe-b190-20533762fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:06.371620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-35449593-4d1f-45fe-b190-20533762fa81 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:06.373314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-35449593-4d1f-45fe-b190-20533762fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:06.429286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:06.452798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 484/967] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:06.704506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612595-cf12-4e27-bff5-5a76109a1d6c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:06.705115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612595-cf12-4e27-bff5-5a76109a1d6c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:06.705115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612595-cf12-4e27-bff5-5a76109a1d6c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:06.706639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 484/968] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:06.711760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:06.712198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:06.712297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:06.730503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612595-cf12-4e27-bff5-5a76109a1d6c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:06.737252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:06.738477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:06.853133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 485/969] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:06.875575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:06.891704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612595-cf12-4e27-bff5-5a76109a1d6c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:06.934003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:06.934633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:06.934633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:06.934894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:06.935353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:06.936738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8a21bf3d-7b40-4553-a6f8-f875ae1f1b08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:06.946425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:06.947552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:06.950192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 485/970] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:01:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:06.955019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.044029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f634-d44a-4e2f-a8d8-742574ab6129 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.044314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f634-d44a-4e2f-a8d8-742574ab6129 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.044569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58f634-d44a-4e2f-a8d8-742574ab6129 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.045964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 486/971] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:01:07.051313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.051584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.051853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.071854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:07.073115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:07.087403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0728-dd18-4df7-a37c-e72cbca91071 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.104475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:07.130567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.131205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.131481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.131755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.132388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:07.132690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.134096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.139087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 486/972] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:07.139885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.151168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 487/973] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:07.152027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.266600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:07.278837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1158b-ed1c-4dc5-8ef8-04e540982529 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.294079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a798bc-943e-40e0-b40e-b2d0f1bdbd39 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.325935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.326787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.327199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.327317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.328040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.329565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.345856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.346522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.346799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.347070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.347716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:07.348020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.349889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.361918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 488/974] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:07.362118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 487/975] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:01:07 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:07.363303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.424331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.489193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:07.542991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d076-892d-4563-a11b-e6defbea0677 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.606413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.607071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.607341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.607600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.608321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] RBAC: Adding query filter params (interface=admin, service_id=f28753454013487e84cdba54579a29d6, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:07.608669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.610099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.613618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414373-fa2c-460f-9400-ce11bb4e0b2a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.620881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 489/976] 10.222.0.61 () {56 vars in 1249 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/endpoints?service_id=f28753454013487e84cdba54579a29d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:07.627140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.642774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:07.666862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.667525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.667915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.668304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.681947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:07.688577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:07.689673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:07.690637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 488/977] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:07.697298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:07.794796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44201f-988e-4314-abc4-cfb5414a7f49 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.840586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:07.845295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.846053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.846432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.846735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.847416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.848913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.852625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2978-554e-4f4e-97c8-9ca002398411 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:07.863467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 490/978] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/services => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:01:07.904035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:07.904593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:07.904705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:07.905047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:07.905723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:07.906097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:07.907514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:07.917542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 489/979] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:07.923983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:08.010705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:08.050537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844b59-206f-4bb2-a4ff-2fbcf1d63a1a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:08.088026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:08.088664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:08.088967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:08.089236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:08.100391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:08.101961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:08.116992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:08.118130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:08.119128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:08.119128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:08.119128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:08.119128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 491/980] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:08.126139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:08.247254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0621b-5e29-4695-86fa-f39f3a325f76 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:08.291359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:08.291965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:08.292238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:08.292507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:08.293712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:08.294232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:08.296620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:08.311479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 490/981] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:08.316995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:08.451963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3583-7205-4746-9933-6e046ed49e6e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:08.479143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:08.494600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:08.495547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:08.496132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:08.496281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:08.506553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:08.507668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:08.526967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:08.528461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:08.530705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 492/982] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:01:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:08.536999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:08.558762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:08.668224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920481-7b31-41b8-8f7f-9044f0603bbd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:08.712562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:08.713210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:08.713487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:08.713750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:08.714525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:08.715153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:08.716705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:08.740720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 491/983] 10.222.0.61 () {56 vars in 1149 bytes} [Mon Aug 29 20:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:08.742623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:08.865121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9827-5a09-4001-b061-d5c016cc051b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:08.901503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:08.902250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:08.902723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:08.902858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:08.956802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:08.983378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:08.984879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:09.099038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 493/984] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:08 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:09.101108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:09.192870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:09.227868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbfc4-55e3-4fd4-8142-e04e7eaf7c39 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:09.270153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:09.270854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.271063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.271351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.284102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:09.285764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-096c96d0-2b8b-42b6-892b-6a5fe0b16dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:09.303928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:09.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:09.306167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:09.306167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:09.306167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:09.309276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 492/985] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:09.311764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:09.414015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:09.441206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad044-60d2-42b8-a835-fa4db285b1df None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.441540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad044-60d2-42b8-a835-fa4db285b1df None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.441920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad044-60d2-42b8-a835-fa4db285b1df None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.442536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4bb8-89ab-4a9e-8c67-69415ec9ffa3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:09.443670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 493/986] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:09.450757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.451600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.452235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.474311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:09.475902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:09.484518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:09.485092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.485364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.485627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.486652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:09.486652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:09.488375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:09.503742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 494/987] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:09.509757 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:09.584264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 494/988] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:09.651125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25112c36-3746-46ac-bcc7-c5c6e5a6a9e2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:09.711313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:09.711962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.712226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.712493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.720330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:09.721888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d09203b3-6473-4e81-9c15-341b120f46c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:09.740933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:09.742469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:09.744050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:09.748983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 495/989] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:09.750488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:09.834348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:09.839973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee699d-c715-4725-bdf8-925321d04efb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.840241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee699d-c715-4725-bdf8-925321d04efb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.840519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee699d-c715-4725-bdf8-925321d04efb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.844931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 496/990] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:01:09.847528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.847774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.848055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.854449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:09.868396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:09.870017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:09.900871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d480f-609a-4f82-8624-a8cd6c3629d6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:09.939815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:09.940806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:09.941259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:09.941716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:09.944490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:09.945022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:09.947484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:09.953864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 497/991] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:09.955487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:09.978751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 495/992] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:09.981739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.131281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670425e-aeb9-4ad3-8324-b9789e9cf496 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.142180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e47fe-aead-4a98-8b7e-46cde169b4fa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.160371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:10.166569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:10.172687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.173448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.173673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.173956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.174475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.175840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:10.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:10.186613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:10.187582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 498/993] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:10.189725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.190480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.190780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.191099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.191900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] RBAC: Adding query filter params (role.id=0c116a921bbf4d408872c84db699c0f8, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=8618c519c27c404db3205746c53f58b1) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:10.192262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.194024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.195487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.201833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 496/994] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:09 2022] GET /identity/v3/role_assignments?user.id=8618c519c27c404db3205746c53f58b1&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=0c116a921bbf4d408872c84db699c0f8 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:10.338264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.392890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8764d-d350-45c7-979c-ade42dd036e7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.446158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.446815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.447098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.447357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.447998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:10.448294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.450237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.456804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 499/995] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:10.463389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.512033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba76a6-75ca-4e0b-b5c5-bc47a26fff80 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.546892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:10.554316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.554965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.555246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.555511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.556105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.557874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:10.574492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:10.575744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:10.576920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 497/996] 10.222.0.61 () {56 vars in 1126 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:10.582447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.611388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abee11-fcea-4011-b9d7-59d6dd092903 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.644921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:10.669386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.670277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.670666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.671047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.675502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:10.675502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.675502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.688815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 500/997] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:10.696886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.769763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf2af-8acf-41cc-8a82-0a7c491d102a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.842034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.843027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.843482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.843929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.845100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:10.845587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.848081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.857122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ab5a-52a0-4243-a8b1-427a461b6937 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:10.860835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 498/998] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:10.866303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:10.898893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:10.916187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:10.917232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:10.917715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:10.918158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:10.919345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] RBAC: Adding query filter params (interface=public, service_id=439b61bb29434c5bb82db01aa3f6cfec, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:10.919829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:10.922135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:10.936350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 501/999] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/endpoints?service_id=439b61bb29434c5bb82db01aa3f6cfec&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:10.937423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:11.040596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708caeb1-6be3-41b7-b924-25b246719e7a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:11.057240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:11.077011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc844011-5a0e-4b54-bbf3-4b50c792e634 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:11.115953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:11.117010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:11.117490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:11.118220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:11.119078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:11.119909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:11.122935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:11.131393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:11.132292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:11.132690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:11.133238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:11.134304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:11.136831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50572ce2-e43d-4900-ae14-e820973fc4f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:11.140200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 499/1000] 10.222.0.61 () {56 vars in 1122 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:11.141609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:11.149096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 502/1001] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:01:10 2022] GET /identity/v3/services => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:01:11.289067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb503b9-c81c-4cf0-a9c8-9d661b72b887 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:11.332994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:11.333629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:11.333903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:11.334174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:11.334992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:11.336601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ed92a-d002-4122-8e67-ca11493e9511 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:11.360641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 500/1002] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:01:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:12.587519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb36c0-e649-4d89-9d4e-1515670942c2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:12.588351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb36c0-e649-4d89-9d4e-1515670942c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:12.588489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb36c0-e649-4d89-9d4e-1515670942c2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:12.590408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 503/1003] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:12.597065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:12.597868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:12.597868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:12.627300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:12.628530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:12.665249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:12.751035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 501/1004] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:12 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:13.077695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb36c0-e649-4d89-9d4e-1515670942c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:13.149191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:13.233088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb36c0-e649-4d89-9d4e-1515670942c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:13.273284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:13.274018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.274294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.274564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] PATH_INFO: `/v3/services/image` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.275170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:13.276658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cf17c846-cdd9-4124-afc7-6c2a1575ec02 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:13.287359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:13.288669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:13.290630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:13.293423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 504/1005] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Aug 29 20:01:13 2022] GET /identity/v3/services/image => generated 86 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:13.295103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:13.478195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10526c-fef2-4da8-9ad5-ee2f93051892 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:13.492450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe979c-e42e-478d-aa7c-697c2e6748a5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.492937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe979c-e42e-478d-aa7c-697c2e6748a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.493285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe979c-e42e-478d-aa7c-697c2e6748a5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.495113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 505/1006] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:13.501630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc4d8-5c88-4737-863f-6c5bc1864f0d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.501913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc4d8-5c88-4737-863f-6c5bc1864f0d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.502207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc4d8-5c88-4737-863f-6c5bc1864f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.523389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-382dc4d8-5c88-4737-863f-6c5bc1864f0d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:13.525416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-382dc4d8-5c88-4737-863f-6c5bc1864f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:13.540546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:13.542021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.542590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.543091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.544402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] RBAC: Adding query filter params (name=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:13.545441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:13.547527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:13.554530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 502/1007] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:13.562308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:13.599945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:13.626261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 506/1008] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:13.672448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3061d-96c2-41c9-8f25-a8feb0016e18 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.672720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3061d-96c2-41c9-8f25-a8feb0016e18 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.673579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3061d-96c2-41c9-8f25-a8feb0016e18 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.674527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 507/1009] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:01:13.680326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.680591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.680903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.703089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:13.704503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:13.750337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7fc1-bbda-41ab-8172-99483145238f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:13.763859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:13.799906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 508/1010] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:13.813108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:13.814081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:13.814532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:13.814959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:13.816032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] RBAC: Adding query filter params (type=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:13.816530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:13.818852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:13.824878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 503/1011] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:13.929961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.084771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5c8e4-2e85-4d9a-a1de-abb41eeda4a5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.103092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.139092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.139764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.140499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.140791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.141697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.143705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:14.161870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:14.163890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:14.166074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 509/1012] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:14.171991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.237276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:14.252042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:14.281932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56746be9-68cb-4c63-b798-5c9bd178a287 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.340498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20906-b999-4af4-997f-ca126e582a3b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.343134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.343867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.344337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.344867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.346950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.348825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.350965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 504/1013] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:14.364377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.398042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.399055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.399553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.400002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.401148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:14.401419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.404462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.416804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 510/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:14.421147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.518543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06b3d-e0f3-45a5-8923-a2b495962e4f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.578723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.579573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.580151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.580488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.581647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.583645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.588523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42cd5-531f-48f6-a406-3355ff6f47e2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.593443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:14.629105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 505/1015] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:01:14 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:01:14.662099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.663338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.663953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.664527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.665870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:14.666511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.668803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430eeec-c3ad-4220-b2d9-70aec3d7d96c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.677247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 511/1016] 10.222.0.61 () {56 vars in 1112 bytes} [Mon Aug 29 20:01:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:14.685496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:14.691882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:14.877280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36933b9-bcf5-4ecf-8972-62fe5882aff6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:14.930415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:14.931176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:14.931546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:14.931899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:14.933047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:14.935729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c6a45-ed50-4ac0-8fe6-0faf9efce960 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:14.972917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 506/1017] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:01:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:15.926221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e6d9-2c45-4ab2-af22-e890b54c841f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:15.926805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e6d9-2c45-4ab2-af22-e890b54c841f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:15.926805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26e6d9-2c45-4ab2-af22-e890b54c841f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:15.928529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 512/1018] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:15.934952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa496ff-30ea-4184-8fdb-fa6b7e13c33c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:15.935510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa496ff-30ea-4184-8fdb-fa6b7e13c33c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:15.935510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa496ff-30ea-4184-8fdb-fa6b7e13c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:15.954856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9aa496ff-30ea-4184-8fdb-fa6b7e13c33c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:15.956051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9aa496ff-30ea-4184-8fdb-fa6b7e13c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:16.026853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:16.058861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 507/1019] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:16.350544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e6d9-2c45-4ab2-af22-e890b54c841f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:16.460615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26e6d9-2c45-4ab2-af22-e890b54c841f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:16.503859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:16.504847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:16.505284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:16.505688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:16.507166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:16.508466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e685cf0-89dd-4162-a213-3d515587346a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:16.531015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 513/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:01:16 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:01:16.892628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9300f-4ddd-48c6-a76b-f5a951683c87 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:16.893164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9300f-4ddd-48c6-a76b-f5a951683c87 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:16.893457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9300f-4ddd-48c6-a76b-f5a951683c87 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:16.895509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 508/1021] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:16.902064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e085f-c555-42fc-93f0-de540ca32f4f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:16.902339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e085f-c555-42fc-93f0-de540ca32f4f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:16.902774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e085f-c555-42fc-93f0-de540ca32f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:16.927345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ee6e085f-c555-42fc-93f0-de540ca32f4f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:16.928535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ee6e085f-c555-42fc-93f0-de540ca32f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:16.957687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:17.037454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 514/1022] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:17.080374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865fef-159f-4d07-84e9-9e0ccc8d37f9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.080951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865fef-159f-4d07-84e9-9e0ccc8d37f9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.080951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865fef-159f-4d07-84e9-9e0ccc8d37f9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.082465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 509/1023] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:17.088348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.088667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.088929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.110384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:17.111603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:17.222200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 515/1024] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:17.384980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e865fef-159f-4d07-84e9-9e0ccc8d37f9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:17.504340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:17.518357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e865fef-159f-4d07-84e9-9e0ccc8d37f9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:17.569429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:17.570535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.571270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.571532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.573662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:17.575707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:17.580853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 510/1025] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:17.585984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:17.628741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:17.645966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f6bcb-0eea-4be5-825e-8d54066f03e3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:17.671392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:17.692764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:17.693437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.693709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.693973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.708612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:17.713585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:17.714667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:17.715539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 516/1026] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:01:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:17.721640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:17.740178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516a7f5-8986-4c00-9b9a-0c30887fb8fa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:17.788762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:17.789354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.789611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.789934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.790599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:17.792052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:17.822390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 511/1027] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:01:17 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:17.874016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f785f-99ad-4b8e-962e-6361d8c49ffa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:17.931191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:17.932255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:17.932694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:17.933279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:17.934590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:17.935083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:17.937505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:17.953643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 517/1028] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:01:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:17.955449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:18.106433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af693ae-44e6-4a9a-80e9-b45e02c9b434 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:18.123757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:18.155137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:18.155783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.156060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.156319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.168440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:18.170123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:18.185730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:18.186792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:18.193305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:18.193305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:18.193305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:18.193305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 512/1029] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:18.195056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:18.205506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:18.319170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3ec6-3a65-4d3b-afbb-9202c38ff541 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:18.358899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:18.359472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.359743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.359984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.360670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:18.361034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:18.362493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:18.377764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 518/1030] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:18.383490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:18.502359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571f4e-8666-4fff-84e9-2a4320b08836 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:18.548782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:18.549438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.549714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.549983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.558661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:18.560558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8343ab0d-f286-4a35-a5ac-efaff67ebf55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:18.573157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:18.574192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:18.575370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:18.576857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 513/1031] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:01:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:18.580966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:18.663350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:18.721043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e48083-7716-4d95-a0d6-c382198f3c1b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:18.722027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414824-5cf5-46fb-bfff-1b5b1cfdfe4f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.723298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414824-5cf5-46fb-bfff-1b5b1cfdfe4f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.724776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414824-5cf5-46fb-bfff-1b5b1cfdfe4f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.727224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 514/1032] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:18.734557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.734898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.735147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.758065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:18.759490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:18.768411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:18.769389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.770392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.770848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:18.772304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:18.772920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:18.775435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:18.782800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:18.803215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 519/1033] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:01:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:18.804469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:18.853504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 515/1034] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:18.922923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2692a-18ed-49db-8f15-4419e7177370 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:18.960588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:18.982077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:18.983072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:18.983564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:18.983976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.104873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.107594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.135585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.264864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 520/1035] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:01:19.268992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.271734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487da14-6690-4fd9-91db-42c1c87ef95a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.302793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:19.315400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.316114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.316394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.316764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] PATH_INFO: `/v3/services/image` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.317744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.320126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:19.336480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:19.341254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:19.342132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 516/1036] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:19.344689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.368962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:19.405837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e0c41-7248-4e92-8a7c-9e9f96bdf1db None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.458348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.459105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.459392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.459632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.473699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.475238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:19.492013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:19.499680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:19.500810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:19.500810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:19.500810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:19.501026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4d1e-73cc-4a53-8d19-ea8ffd846f52 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.501117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 521/1037] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:19.501117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.542139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.542740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.543010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.543272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.544057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:19.544557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.546321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.552305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 517/1038] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:19.558897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.603509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:19.641217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f868ea3-9226-4d5e-9fd3-01d27a925e32 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.685693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:19.694188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.694818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.695136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.695407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.696059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:19.696359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.697865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.712091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f4a3a-ce1c-4c1f-9b0d-716ef6e990d3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.717160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 522/1039] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:19.718199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.763497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.764248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.764550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.765034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.766116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:19.766627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.769082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.778264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 518/1040] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:19.784299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:19.866227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893377cb-979d-42b5-a61b-7e234f244bf9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.918481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:19.919162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:19.919935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:19.920214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:19.927091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:19.933968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:19.936459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:19.942715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4de187-b334-42da-8f5b-3aa30a7a39fb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:19.949569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:19.950587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:19.951514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 523/1041] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:19.963493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:20.003832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:20.004794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.005265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.005548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.006736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] RBAC: Adding query filter params (interface=public, service_id=119de5da092044b489b90adb12f0fb76, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:20.007287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:20.009054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:20.020169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 519/1042] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/endpoints?service_id=119de5da092044b489b90adb12f0fb76&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:20.029449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:20.050431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:20.131908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7365c3-bda4-4479-83a3-d371f5bdd801 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:20.165981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb331c-f25a-4d9e-95b2-0773a71b6b13 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:20.176810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:20.177424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.177727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.178016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.178682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:20.178974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:20.180446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569b60-013f-48f0-b83a-bec84e33b7cb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:20.194517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 524/1043] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:20.195955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5515d2-4ab7-47da-a800-45ceef3aed55 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.196237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5515d2-4ab7-47da-a800-45ceef3aed55 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.196506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5515d2-4ab7-47da-a800-45ceef3aed55 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.197780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 525/1044] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:20.201210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5515d2-4ab7-47da-a800-45ceef3aed55 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:20.221828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:20.222466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.222766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.223106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.223726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:20.225203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66a2d0-12ee-466f-bf4d-1940332dddd9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:20.238046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 520/1045] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:01:20 2022] GET /identity/v3/services => generated 1957 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:01:20.240730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.241236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.241659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.266425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:20.267680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:20.293756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:20.358672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5515d2-4ab7-47da-a800-45ceef3aed55 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:20.372991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 521/1046] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:20.405844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:20.406467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.406741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.407009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.407747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] RBAC: Adding query filter params (role.id=0c116a921bbf4d408872c84db699c0f8, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:20.408052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:20.409526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:20.415508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 526/1047] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:20 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=0c116a921bbf4d408872c84db699c0f8 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:20.642765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:20.645033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:20.784589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce6134-9f3c-4849-9b4d-911a48d0ebb9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:20.825345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:20.826066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:20.826365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:20.826649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:20.839514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:20.845367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:20.846353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:20.847259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 522/1048] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:20.854256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:20.969011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e1307-fb45-40e6-9167-0b8d16bff151 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:20.989603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:21.005221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:21.005839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:21.006107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:21.006368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:21.007035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:21.007330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:21.008678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:21.018525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 527/1049] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:21.024088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:21.091064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:21.132863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1932-f1e2-4f9f-a314-9c6463458454 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:21.178815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:21.179526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:21.179776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:21.180004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] PATH_INFO: `/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:21.194247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] RBAC: Authorizing `identity:get_user(user_id=1b0104dcc4a74f1881e7a2e646d0adc9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:21.195713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:21.197632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 523/1050] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:21 2022] GET /identity/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:21.203828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:21.318166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f77d82-ba87-481f-bbf0-496aab670ee7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:21.356137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:21.356814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:21.357104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:21.357364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:21.415073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:21.438060 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:21.439558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:21.549479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 528/1051] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:21.555244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:21.688734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b1ab9-6da1-4b71-aaf2-2b2cd6053869 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:21.719413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:21.738045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:21.738684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:21.738950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:21.739224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:21.740375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:21.741843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7831e8f-91a3-497e-926f-3f50bf7ffea5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:21.743653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 524/1052] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:21 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:21.751032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:21.848764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:21.872287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba186-7eec-4202-b139-4ceb209b2ca6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:21.918144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:21.919105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:21.919551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:21.920022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:21.921306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=986b1502c29247e890006f68461aed82, user.id=1b0104dcc4a74f1881e7a2e646d0adc9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:21.921806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:21.924310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1797-9523-4a48-937b-44edd52f8646 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:21.940868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 529/1053] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:21 2022] GET /identity/v3/role_assignments?user.id=1b0104dcc4a74f1881e7a2e646d0adc9&scope.project.id=986b1502c29247e890006f68461aed82&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:22.242666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c649f-d932-41fe-a799-91019c2b8cc4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.243410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c649f-d932-41fe-a799-91019c2b8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.243410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c649f-d932-41fe-a799-91019c2b8cc4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.245025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 525/1054] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:22.250918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393bc-738a-43e1-9f64-e716d03bc77b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.251719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393bc-738a-43e1-9f64-e716d03bc77b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.251719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d393bc-738a-43e1-9f64-e716d03bc77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.272967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d6d393bc-738a-43e1-9f64-e716d03bc77b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:22.274163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6d393bc-738a-43e1-9f64-e716d03bc77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:22.362155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 530/1055] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:22.407045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f225-0d7e-45c5-a37b-c677aa26cf4e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.407412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f225-0d7e-45c5-a37b-c677aa26cf4e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.407586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2f225-0d7e-45c5-a37b-c677aa26cf4e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.409175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 526/1056] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:22.414610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.414922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.415198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.435316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:22.437160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:22.512053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 531/1057] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:22.631528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f225-0d7e-45c5-a37b-c677aa26cf4e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:22.783556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:22.783736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2f225-0d7e-45c5-a37b-c677aa26cf4e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:22.792804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:22.821704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:22.822339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.822616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.822883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] PATH_INFO: `/v3/services/image` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.823676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:22.825585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:22.834484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:22.835556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:22.836503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 527/1058] 10.222.0.61 () {56 vars in 1105 bytes} [Mon Aug 29 20:01:22 2022] GET /identity/v3/services/image => generated 86 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:22.841798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:22.909460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31096e8-d33f-44a7-8b80-381b719a5848 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:22.917358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:22.947676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:22.948434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:22.948838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:22.949314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:22.960783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:22.965818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:22.966777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:22.967654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:22.972365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 532/1059] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:01:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:22.973289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:22.975725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46d171-1686-49cb-8c45-61aa85c99133 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.016937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.017708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.018150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.018419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.019203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] RBAC: Adding query filter params (name=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:23.019378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.021309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.033720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 528/1060] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:23.035642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.057027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:23.103056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6701bff-3093-4525-b380-57ed20f65862 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.147050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.147676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.147945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.148204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.148903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:23.149788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.150694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.171835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 533/1061] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:01:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:23.174569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.190238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e288697-7029-4eee-baa9-c0f94698be0a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.208295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:23.232023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.232707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.233010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.233284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.233949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] RBAC: Adding query filter params (type=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:23.234268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.235741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.247159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 529/1062] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:23.248797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.302496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea62ca-c9fc-4ce7-af56-2358fb8499af None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.337105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:23.348842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.349921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.350190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.350732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.359318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2d88b-0263-4065-bf37-776e39238c8b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.365887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.367925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:23.385065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:23.386340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:23.387443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:23.387443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:23.387443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:23.387443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 534/1063] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:23.392914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.400446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.401200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.401690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.403230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.404007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.405786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.429293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 530/1064] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:01:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:23.528806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1d23-4be0-4ca1-8b7c-6a51cf93ee70 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.577824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.578350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.578641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.578946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.579693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:23.580043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.581480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.596735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 535/1065] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:23.602873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.646992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:23.721643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae8e59-c4f1-4b81-8866-799c4b441cf5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.762552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.763398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.763613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.763912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.772315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.773797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:23.785652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:23.786689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:23.787724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:23.789134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 531/1066] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:23.794044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.836350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:23.914325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6143a-713f-4cd2-a8cf-85ba3e071999 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:23.953402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:23.954028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.954350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.954622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.955363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:23.955664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:23.957245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde15f4-8653-4e19-a6c6-d5118f04a785 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:23.976793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 536/1067] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:23.983502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:23.984399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6afb0f-e505-42b2-9c64-864f262c9574 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.984682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6afb0f-e505-42b2-9c64-864f262c9574 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.984985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6afb0f-e505-42b2-9c64-864f262c9574 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:23.986570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 537/1068] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:23.993120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:23.993630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:23.993894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.015388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:24.016544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:24.098456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 538/1069] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:24.100567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.107313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da2dc6-d6c7-4793-96b6-d0514beb5930 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.153306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.154353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.154839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.155318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.169681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.171153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:24.186942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:24.196424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:24.198157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:24.198157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:24.198157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:24.198157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 532/1070] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:24.201269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.247324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.332357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339763-6fad-4c7e-a049-014b7e5e8443 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.368982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.369837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.370497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.371041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.371041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.371212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:24.371542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.372965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.387841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 539/1071] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:24.393906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.491440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2286-562a-4906-8f2a-7506a9e7223f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.507906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.526146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d64b9-2003-41ff-bc35-cf852514397b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.542028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.543093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.543565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.544032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.561954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:24.564670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.565575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.566001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.566414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:24.572404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:24.573819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:24.574891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 533/1072] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:24.581086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.581504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.583031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.594327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:24.596846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:24.598360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:24.599314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:24.603179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 540/1073] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:24.603954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.706584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8ba5-25ea-4dae-a291-995f999c904c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.744977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.745983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.746432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.746845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.747663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:24.748206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.749859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.754143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e31c1-9034-4dd1-b792-759c97568fcd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.760368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 534/1074] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:24.767595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.805576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.806245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.806458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.806725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.807421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:24.808531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.810104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.825792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 541/1075] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:24.832242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.836772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.865505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:24.902997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c11011-7576-4d5c-b27b-14101b6b5c30 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.942988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.943518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.943794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.944127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] PATH_INFO: `/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.945319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] RBAC: Authorizing `identity:get_user(user_id=1b0104dcc4a74f1881e7a2e646d0adc9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.946930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:24.948668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 535/1076] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:24.954830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:24.955201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02717592-78bb-4062-bfc8-b77d104d6992 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:24.993357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:24.994500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:24.994870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:24.995412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/0c116a921bbf4d408872c84db699c0f8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:24.997894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=c5df08926dfe44f3ac00d11414e3513e, role_id=0c116a921bbf4d408872c84db699c0f8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:24.999446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:25.014102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 542/1077] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:01:24 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/c5df08926dfe44f3ac00d11414e3513e/roles/0c116a921bbf4d408872c84db699c0f8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:01:25.097819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ee36-cc17-4623-abc4-7a07fe296f0f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:25.153357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:25.154034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:25.154335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:25.154646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:25.156491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:25.159226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74390b-b89b-48b0-868b-75e6cacd1577 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:25.161652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 536/1078] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:24 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:25.168124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:25.256037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:25.301430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc5106-0a55-4116-ae76-810d35d67830 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:25.346785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:25.347657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:25.348005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:25.348454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82/users/1b0104dcc4a74f1881e7a2e646d0adc9/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:25.351651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=986b1502c29247e890006f68461aed82, user_id=1b0104dcc4a74f1881e7a2e646d0adc9, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:25.354171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77db5aa-7e45-4ddc-9d82-d81f5f357ad7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:25.368726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 543/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:01:25 2022] PUT /identity/v3/projects/986b1502c29247e890006f68461aed82/users/1b0104dcc4a74f1881e7a2e646d0adc9/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:01:25.433574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb554f-01aa-4621-a6be-50ac580a0f60 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:25.434371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb554f-01aa-4621-a6be-50ac580a0f60 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:25.434371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb554f-01aa-4621-a6be-50ac580a0f60 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:25.435835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 537/1080] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:25.441482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:25.441804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:25.441988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:25.462907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:25.464376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:25.551826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 544/1081] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:01:25.826720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb554f-01aa-4621-a6be-50ac580a0f60 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:25.837145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:25.942002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb554f-01aa-4621-a6be-50ac580a0f60 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:25.984542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:25.985356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:25.985764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:25.986159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:26.085174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:26.086501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:26.099973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:26.204076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 538/1082] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:26.210165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:26.272885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:26.322153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfae9d-8ead-40bd-890f-35e89b3c579d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:26.360353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:26.361383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:26.361383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:26.361638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:26.373405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:26.374849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5ba6aa27-6420-49d6-b10e-fc1f88ea7f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:26.390967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:26.392515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:26.394405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:26.394405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:26.394405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:26.397135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 545/1083] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:26.399205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:26.525418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e662e-bd7a-460f-b260-12efab3263ab None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:26.533633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:26.564042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:26.564651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:26.564969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:26.565239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:26.565899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:26.566181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:26.567542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cefde-3573-4abd-bc5a-97501c7acf34 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:26.584783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 539/1084] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:26.994904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52910-3abd-4749-baf5-205a74c2de0f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:26.995166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52910-3abd-4749-baf5-205a74c2de0f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:26.995378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f52910-3abd-4749-baf5-205a74c2de0f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:26.996794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 546/1085] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:27.002457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f16e6-7cfe-4f91-b459-e15c29809a14 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.002744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f16e6-7cfe-4f91-b459-e15c29809a14 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.003016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f16e6-7cfe-4f91-b459-e15c29809a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.023167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c90f16e6-7cfe-4f91-b459-e15c29809a14 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:27.024360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c90f16e6-7cfe-4f91-b459-e15c29809a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:27.096246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 540/1086] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:27.303868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3e94-dcfe-4fea-9a0a-358e5a2a8679 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.304051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3e94-dcfe-4fea-9a0a-358e5a2a8679 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.304343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3e94-dcfe-4fea-9a0a-358e5a2a8679 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.305730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 547/1087] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:27.311245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.311566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.311844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.330255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:27.331436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:27.362171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3e94-dcfe-4fea-9a0a-358e5a2a8679 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.403644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 541/1088] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:27.466166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3e94-dcfe-4fea-9a0a-358e5a2a8679 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:27.473227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:27.504971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:27.505705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.505912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.506177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.518520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:27.523461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:27.524491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:27.525407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 548/1089] 10.222.0.61 () {56 vars in 1120 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:27.531632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.562454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:27.644675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706a074-5dbf-4e19-a8c6-ac0875356c1a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:27.672705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.691866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:27.692484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.692781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.693055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.693725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:27.694034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:27.695432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:27.704470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 542/1090] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:27.710486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.793464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7c3a-c570-4daa-98c0-4c2a7b2c6268 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:27.809646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:27.822146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a057a-2120-463a-a1b1-8787b01f354f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:27.834888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:27.835927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.836294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.836679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.850860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:27.857782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:27.858800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:27.859686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 549/1091] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:27.861488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:27.862139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:27.862418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:27.862691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:27.865466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.875526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:27.877169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:27.892264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:27.893456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:27.894378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:27.894378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:27.894378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:27.894378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 543/1092] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:27.899341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:27.899519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:27.974294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08193c-b36e-4b6f-950e-fb81735265c0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.009393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235ec87-2464-4a5b-9949-0c29642b27ad None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.012201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.012856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.013129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.013399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.014068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:28.014367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.015754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.025322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 550/1093] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:28.031378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.052662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.053314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.053590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.053863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.054520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:28.054820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.056207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.066703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.073016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 544/1094] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:28.076598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.126849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.141160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306154d5-ccce-4313-a451-4283cc2ee549 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.181080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.181734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.182003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.182278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] PATH_INFO: `/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.183551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] RBAC: Authorizing `identity:get_user(user_id=1b0104dcc4a74f1881e7a2e646d0adc9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.185608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.187794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 551/1095] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/users/1b0104dcc4a74f1881e7a2e646d0adc9 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:28.194588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.194865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac13cb-e4b4-4e83-8ee6-905d572b1fca None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.232467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.233152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.233474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.233744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.241501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.242991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:01:28.255660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:28.262046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:28.263111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 545/1096] 10.222.0.61 () {56 vars in 1093 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:28.263743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.302325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9824b-7a0e-43a8-a853-e47354dc5446 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.328185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.340012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.340624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.340930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.341207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.367533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.376448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598a4e-0065-4171-96ba-d55845691e64 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.413747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.414689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.415257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.415364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.415561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.415829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.416551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:28.417027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.418510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.436725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 546/1097] 10.222.0.61 () {56 vars in 1133 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:28.442762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.532572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 552/1098] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:01:28.538576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.560599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523df144-4b37-474a-aac4-3892463a4eff None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.578639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.596696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.597340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.597617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.597888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.599128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.645188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf13b4-7d03-43be-b5a1-2bb6538846b0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.676473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.678028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.685360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.686088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.686408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.686739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.688171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.689935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.691818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 553/1099] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:28.698623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.786884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 547/1100] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:01:28.793563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:28.803911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b32eee-a90c-420d-91bd-a641b6f8caf5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.814982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.830995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:28.842652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.843265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.843534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.843796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.844515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=986b1502c29247e890006f68461aed82, user.id=1b0104dcc4a74f1881e7a2e646d0adc9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:28.844837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.846320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.852172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 554/1101] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/role_assignments?user.id=1b0104dcc4a74f1881e7a2e646d0adc9&scope.project.id=986b1502c29247e890006f68461aed82&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:28.905364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa33a3-036d-414d-a52b-404d52a10713 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:28.948525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:28.949321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:28.949660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:28.949850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:28.961781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:28.963288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:01:28.980767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:28.981825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:01:28.982872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:01:28.982872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:01:28.982872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:28.982872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 548/1102] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:28.988416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:29.100178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ce06-9d3e-453b-bada-868676a5f72f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:29.135719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:29.136105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:29.136371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:29.136627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:29.137296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:29.137587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:29.138939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:29.150852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 555/1103] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:29.157557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:29.239652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:29.274639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d1dae-a694-4040-b928-c1723e886695 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:29.313358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:29.314049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:29.314279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:29.314548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:29.321733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:29.323952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:01:29.335940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:29.336957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:29.338596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 549/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:01:29.343843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:29.401695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:29.460490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd117-2ddf-4f4f-8dfd-2120f0a81915 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:29.498192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:29.498808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:29.499084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:29.499349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:29.500043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:29.500342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:29.501963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded884-b727-49ba-91c5-e914b2043d5d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:29.515122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 556/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:29.521315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:29.654881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2899d-be9b-4cf7-98f0-e3731d9aac1f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:29.687108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:29.695189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:29.695857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:29.696142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:29.696412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:29.697300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] RBAC: Adding query filter params (role.id=0c116a921bbf4d408872c84db699c0f8, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=c5df08926dfe44f3ac00d11414e3513e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:29.697686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:29.699409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b4350-5a38-498f-99d5-d1f0e79dcd5a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:29.707109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 550/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:29 2022] GET /identity/v3/role_assignments?user.id=c5df08926dfe44f3ac00d11414e3513e&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=0c116a921bbf4d408872c84db699c0f8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:30.851849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522660-2c81-476c-a4cc-d9c72fcdcdff None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:30.852390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522660-2c81-476c-a4cc-d9c72fcdcdff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:30.852390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522660-2c81-476c-a4cc-d9c72fcdcdff None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:30.854267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 557/1107] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:30.861553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:30.862146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:30.862146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:30.881857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:30.883105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:30.971501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 551/1108] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:31.237707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522660-2c81-476c-a4cc-d9c72fcdcdff None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:31.342027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522660-2c81-476c-a4cc-d9c72fcdcdff None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:31.351154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:31.376421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:31.377080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:31.377357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:31.377610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:31.378718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:31.380149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b623486-0dd7-43ed-b4f9-83a2cec312ff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:31.381759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 558/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:31.387772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:31.497585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57f51-8d1a-40c2-9064-4b1b86823976 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:31.522327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:31.534158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:31.534767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:31.535072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:31.535342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:31.536040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:31.537582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f16e95-1170-483b-87e1-26ce24782d81 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:31.560901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 552/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:01:31 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:33.518435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ac83-9726-4842-b1c9-0f283bae42f1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:33.519044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ac83-9726-4842-b1c9-0f283bae42f1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:33.519044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ac83-9726-4842-b1c9-0f283bae42f1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:33.520338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 559/1111] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:33.525814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:33.526880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:33.526880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:33.549979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:33.551162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:33.628124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 553/1112] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:33.908083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ac83-9726-4842-b1c9-0f283bae42f1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:34.025826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ac83-9726-4842-b1c9-0f283bae42f1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:34.062915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:34.063570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:34.063845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:34.064113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] PATH_INFO: `/v3/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:34.065551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] RBAC: Authorizing `identity:get_role(role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:34.066966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:34.068327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 560/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:33 2022] GET /identity/v3/roles/92293530e9464e0ea6885885e170633e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:34.074520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:34.193229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ce3d5-e56d-49bb-ba26-18e077630769 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:34.206686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:34.233431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:34.234059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:34.234326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:34.234587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] PATH_INFO: `/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:34.249299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf68ec63a014a9eb0e3b21a1003cb47)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:34.250749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:34.252430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 554/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:34 2022] GET /identity/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:34.258497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:34.308265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:34.367262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efd008-cb60-42af-a2fc-083998712906 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:34.404037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:34.404642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:34.405215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:34.405487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:34.482090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:34.483443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:34.531897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:34.599473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 561/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:34.605958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:34.712962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292abbb-cc6e-41b5-8c8f-a0521fa347d8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:34.752221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:34.752827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:34.753128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:34.753394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:34.754528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:34.756296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f936150-99f9-4595-bb9e-55d76bacbdd7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:34.757981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 555/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:34 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:34.765372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:34.867849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fd8a-f98f-4a28-911d-a48f8263ef52 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:34.904666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:34.905376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:34.905642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:34.905904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:34.906625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=986b1502c29247e890006f68461aed82, user.id=dbf68ec63a014a9eb0e3b21a1003cb47) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:34.906919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:34.908345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9eb958-9900-4242-afac-42ed3af79297 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:34.914359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 562/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:34 2022] GET /identity/v3/role_assignments?user.id=dbf68ec63a014a9eb0e3b21a1003cb47&scope.project.id=986b1502c29247e890006f68461aed82&role.id=92293530e9464e0ea6885885e170633e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:36.798114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c215e-fadd-4344-88bb-139144b60f78 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:36.798658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c215e-fadd-4344-88bb-139144b60f78 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:36.798658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c215e-fadd-4344-88bb-139144b60f78 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:36.800015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 556/1118] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:36.805736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:36.806412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:36.806623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:36.825314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:36.826496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:36.828570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:36.896716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 563/1119] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:37.172604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c215e-fadd-4344-88bb-139144b60f78 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:37.216191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:37.293740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c215e-fadd-4344-88bb-139144b60f78 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:37.332284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:37.332946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:37.333228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:37.333497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] PATH_INFO: `/v3/roles/92293530e9464e0ea6885885e170633e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:37.334916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] RBAC: Authorizing `identity:get_role(role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:37.336299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:37.337682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 557/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:37 2022] GET /identity/v3/roles/92293530e9464e0ea6885885e170633e => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:37.344221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:37.455937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeca1f-4ffc-4590-ab73-7e620d9524b0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:37.499024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:37.499759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:37.500077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:37.500409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] PATH_INFO: `/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:37.501673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] RBAC: Authorizing `identity:get_user(user_id=dbf68ec63a014a9eb0e3b21a1003cb47)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:37.503163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:37.504793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 564/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:37 2022] GET /identity/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:37.511201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:37.625738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869e97-a225-49aa-b6a0-41b3581df310 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:37.628200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:37.662789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:37.663437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:37.663713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:37.663985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:37.665157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:37.666637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036ad4e-aa6d-4ea8-8ad2-337048c33831 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:37.668315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 558/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:37 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:37.674698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:37.683958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:37.781516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe02ba0-0f6f-4019-a296-070f72952b1b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:37.819465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:37.820196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:37.820382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:37.820654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82/users/dbf68ec63a014a9eb0e3b21a1003cb47/roles/92293530e9464e0ea6885885e170633e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:37.823017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=986b1502c29247e890006f68461aed82, user_id=dbf68ec63a014a9eb0e3b21a1003cb47, role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:37.824453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490fdd-084b-4a3e-b197-88ccbf0b80e7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:37.838811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 565/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:01:37 2022] PUT /identity/v3/projects/986b1502c29247e890006f68461aed82/users/dbf68ec63a014a9eb0e3b21a1003cb47/roles/92293530e9464e0ea6885885e170633e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:01:39.759039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e4d0-70c5-4fe9-a00a-08636f7135d1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:39.759631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e4d0-70c5-4fe9-a00a-08636f7135d1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:39.759631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6e4d0-70c5-4fe9-a00a-08636f7135d1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:39.761176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 559/1124] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:39.766482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:39.766960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:39.767062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:39.787916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:39.789211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:39.854438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:39.864068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 566/1125] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:40.131200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e4d0-70c5-4fe9-a00a-08636f7135d1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:40.239509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6e4d0-70c5-4fe9-a00a-08636f7135d1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:40.281990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:40.282616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:40.282891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:40.283157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] PATH_INFO: `/v3/roles/92293530e9464e0ea6885885e170633e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:40.284546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] RBAC: Authorizing `identity:get_role(role_id=92293530e9464e0ea6885885e170633e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:40.285955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:40.287265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 560/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:40 2022] GET /identity/v3/roles/92293530e9464e0ea6885885e170633e => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:40.294051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:40.404203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff54e9-fb82-414d-b5c7-73392f54814c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:40.440921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:40.441559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:40.441841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:40.442109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] PATH_INFO: `/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:40.443273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] RBAC: Authorizing `identity:get_user(user_id=dbf68ec63a014a9eb0e3b21a1003cb47)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:40.444697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:40.446335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 567/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:40 2022] GET /identity/v3/users/dbf68ec63a014a9eb0e3b21a1003cb47 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:40.452645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:40.499038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:40.561120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0ae90-123e-4c8b-be3d-87b000624dd4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:40.598546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:40.599183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:40.599455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:40.599722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:40.671259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:40.672648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:40.715389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:40.780518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 561/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:40.786905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:40.852932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:40.892558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e938be-645f-4b1f-9a95-632f5fc1d2bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:40.929370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:40.929899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:40.930162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:40.930427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] PATH_INFO: `/v3/projects/986b1502c29247e890006f68461aed82` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:40.931566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] RBAC: Authorizing `identity:get_project(project_id=986b1502c29247e890006f68461aed82)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:40.933315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726ce43-e51f-4e93-8af0-e85046c5ee87 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:40.934950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 568/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:40 2022] GET /identity/v3/projects/986b1502c29247e890006f68461aed82 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:40.941361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:41.045165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45abc9a-4321-4cce-893c-9ab4b4ddb191 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:41.081332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:41.082108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:41.082561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:41.082844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:41.083551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] RBAC: Adding query filter params (role.id=92293530e9464e0ea6885885e170633e, scope.project.id=986b1502c29247e890006f68461aed82, user.id=dbf68ec63a014a9eb0e3b21a1003cb47) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:41.083863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:41.085314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b73b9-9502-43fa-aa31-f78eb52eb202 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:41.092013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 562/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:40 2022] GET /identity/v3/role_assignments?user.id=dbf68ec63a014a9eb0e3b21a1003cb47&scope.project.id=986b1502c29247e890006f68461aed82&role.id=92293530e9464e0ea6885885e170633e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:43.022358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c59e9-12f6-495d-8517-e980dcdafc2a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:43.022920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c59e9-12f6-495d-8517-e980dcdafc2a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:43.022920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c59e9-12f6-495d-8517-e980dcdafc2a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:43.024112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 569/1131] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:43.030140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:43.030582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:43.030699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:43.038139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:43.050374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:43.051578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:43.121415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 563/1132] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:43.388059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c59e9-12f6-495d-8517-e980dcdafc2a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:43.496938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c59e9-12f6-495d-8517-e980dcdafc2a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:43.527801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:43.533486 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:43.534116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:43.534388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:43.534646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:43.535754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:43.537218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28540d9f-eec4-480b-97a2-f80c5f8fc954 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:43.538783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 570/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:43.545312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:43.657127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179825c-c282-41bc-9da3-f124ca99d63e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:43.701504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:43.702130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:43.702401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:43.702666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:43.703321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:43.704793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a06e-648b-4454-a50e-84e1eed9af2a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:43.709814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:43.737017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 564/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:01:43 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:45.730767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c3c0c-338c-4765-9c43-c0d849b3e8d8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:45.731358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c3c0c-338c-4765-9c43-c0d849b3e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:45.731358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c3c0c-338c-4765-9c43-c0d849b3e8d8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:45.732683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 571/1135] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:45.738738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:45.739232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:45.739323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:45.759196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:45.760520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:45.834813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 565/1136] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:46.102090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c3c0c-338c-4765-9c43-c0d849b3e8d8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:46.222636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c3c0c-338c-4765-9c43-c0d849b3e8d8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:46.261007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:46.261653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:46.261883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:46.262187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:46.264466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:46.264880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957f59-a679-42ad-a653-e8a45d3e6b13 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:46.266482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 572/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:46.272770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:46.375386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aeddd-aa81-4801-8b2d-0b6e9eb441ba None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:46.392539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:46.413353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:46.413955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:46.414225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:46.414490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:46.415134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:46.416893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8476-d910-46f8-981a-2acdd3a4747f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:46.439617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 566/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:01:46 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:01:48.417688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110b87-a9a5-44ed-a001-05e668ef4ae9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:48.418264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110b87-a9a5-44ed-a001-05e668ef4ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:48.418264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110b87-a9a5-44ed-a001-05e668ef4ae9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:48.419525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 573/1139] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:48.425116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:48.425605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:48.425605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:48.446231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:48.447774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:48.522334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 567/1140] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:48.794480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110b87-a9a5-44ed-a001-05e668ef4ae9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:48.872709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:48.920252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110b87-a9a5-44ed-a001-05e668ef4ae9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:48.965480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:48.966009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:48.966281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:48.966548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:48.979322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:48.984534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:48.986105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:48.987028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 574/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:48.995095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:49.101608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e0ddb-a7af-4414-994c-f12d73f2f2e3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:49.103287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:49.144085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:49.144698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:49.145002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:49.145304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:49.146150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:49.146566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:49.148288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:49.158176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 568/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:49.164560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:49.281769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf57f3-2b0e-460f-a458-ad33ab331520 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:49.311314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:49.322606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:49.323324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:49.323605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:49.323865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] PATH_INFO: `/v3/users/15a570df6fa94c29b0462891f50e6174` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:49.337638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=15a570df6fa94c29b0462891f50e6174)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:49.339158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:49.340865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 575/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:49 2022] GET /identity/v3/users/15a570df6fa94c29b0462891f50e6174 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:49.347189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:49.456651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d706e1a-cd56-4e08-b905-9a1d4fcb4200 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:49.492494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:49.493461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:49.493738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:49.494003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:49.527536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:49.573529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:49.574883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:49.697376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 569/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:49.704205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:49.818525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9981b5-fa4a-4104-8e95-c3f2294e6fc3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:49.860072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:49.860682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:49.861025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:49.861342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] PATH_INFO: `/v3/projects/1e48b3f820a245a6b30e52d04bb892f7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:49.862607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] RBAC: Authorizing `identity:get_project(project_id=1e48b3f820a245a6b30e52d04bb892f7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:49.864034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2b6e1-ecd9-4372-a1b0-a56edd9b2c23 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:49.865709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 576/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:49 2022] GET /identity/v3/projects/1e48b3f820a245a6b30e52d04bb892f7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:49.872778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:49.942484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:49.986793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019998-5466-4b31-8e38-f36c34038f30 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:50.027451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:50.028070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:50.028349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:50.028714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:50.029506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=1e48b3f820a245a6b30e52d04bb892f7, user.id=15a570df6fa94c29b0462891f50e6174) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:50.029813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:50.031275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c6e0-fba4-4196-9e7d-9d787dc56502 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:50.037723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 570/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:49 2022] GET /identity/v3/role_assignments?user.id=15a570df6fa94c29b0462891f50e6174&scope.project.id=1e48b3f820a245a6b30e52d04bb892f7&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:51.951618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f4bf-b10f-4af6-8e6c-cee51f6cdb20 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:51.952160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f4bf-b10f-4af6-8e6c-cee51f6cdb20 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:51.952160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f4bf-b10f-4af6-8e6c-cee51f6cdb20 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:51.953470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 577/1147] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:51.959122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:51.959607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:51.959607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:51.978607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:51.979957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:52.051118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 571/1148] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:52.323838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f4bf-b10f-4af6-8e6c-cee51f6cdb20 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:52.403203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:52.454447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f4bf-b10f-4af6-8e6c-cee51f6cdb20 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:52.490843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:52.491475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:52.491742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:52.492003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:52.503056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:52.507770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:52.508890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:01:52.509995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 578/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:52.517936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:52.581203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:52.628267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a5f8-cde8-463f-b220-e258887c07da None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:52.663999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:52.664607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:52.664992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:52.665266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:52.666146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:52.666470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:52.667969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:52.676622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 572/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:52.683165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:52.787907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46eecb-2fd4-4e8e-963a-9f617d99d076 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:52.802696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:52.825755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:52.826022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:52.826256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:52.826516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] PATH_INFO: `/v3/users/15a570df6fa94c29b0462891f50e6174` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:52.827645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] RBAC: Authorizing `identity:get_user(user_id=15a570df6fa94c29b0462891f50e6174)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:52.829218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:52.830791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 579/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:52 2022] GET /identity/v3/users/15a570df6fa94c29b0462891f50e6174 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:52.837006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:52.948197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf775b-6c5f-4b7d-82e7-2ded3a8ad72b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:52.969138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:52.985383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:52.986020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:52.986295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:52.986571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] PATH_INFO: `/v3/projects/1e48b3f820a245a6b30e52d04bb892f7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:52.987698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] RBAC: Authorizing `identity:get_project(project_id=1e48b3f820a245a6b30e52d04bb892f7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:52.989179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201564f-aa14-4cb6-9365-df97f17ad33d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:52.990864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 573/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:52 2022] GET /identity/v3/projects/1e48b3f820a245a6b30e52d04bb892f7 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:52.997643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:53.107309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46be9-a270-4e66-b9d6-d1c7357d21fa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:53.144763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:53.145440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:53.145711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:53.145980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] PATH_INFO: `/v3/projects/1e48b3f820a245a6b30e52d04bb892f7/users/15a570df6fa94c29b0462891f50e6174/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:53.148000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e48b3f820a245a6b30e52d04bb892f7, user_id=15a570df6fa94c29b0462891f50e6174, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:53.149465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734942b-6461-4ae6-a780-f636574a2f07 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:53.164322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 580/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:01:52 2022] PUT /identity/v3/projects/1e48b3f820a245a6b30e52d04bb892f7/users/15a570df6fa94c29b0462891f50e6174/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:01:55.821197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b427a-7342-41b1-9055-f6707359bc84 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:55.821752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b427a-7342-41b1-9055-f6707359bc84 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:55.821752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b427a-7342-41b1-9055-f6707359bc84 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:55.823099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 574/1154] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:55.828610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:55.829150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:55.829150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:55.850016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:55.851224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:55.891407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:55.939264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 581/1155] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:56.204413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b427a-7342-41b1-9055-f6707359bc84 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:56.324266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b427a-7342-41b1-9055-f6707359bc84 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:56.359563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:56.360180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:56.360450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:56.360712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:56.372352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:01:56.377086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:01:56.378251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:01:56.379319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:01:56.380934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 575/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:01:56.385859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:56.488092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725593a-9c4d-4dfa-8db5-454acdef8591 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:56.524959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:56.525750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:56.526027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:56.526290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:56.526946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:56.527233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:56.528797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:56.537352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 582/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:56.543817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:56.596650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:56.657632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc929-fe2e-4ff8-940e-44fd89fed125 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:56.699921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:56.700613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:56.700926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:56.701189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] PATH_INFO: `/v3/users/15a570df6fa94c29b0462891f50e6174` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:56.702422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] RBAC: Authorizing `identity:get_user(user_id=15a570df6fa94c29b0462891f50e6174)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:56.703899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:56.705531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 576/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:01:56 2022] GET /identity/v3/users/15a570df6fa94c29b0462891f50e6174 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:56.711857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:56.749310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:56.816536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb028a0-8988-4e60-90df-1064c3d0fb05 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:56.850903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:56.851611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:56.851770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:56.852031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:56.923016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:56.924471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:56.957690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:57.024812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 583/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:01:57.030982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:57.136649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f38e86-bb9e-4384-8942-42d96dd4fd03 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:57.154944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:57.174702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:57.175366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:57.175636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:57.175904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] PATH_INFO: `/v3/projects/1e48b3f820a245a6b30e52d04bb892f7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:57.177054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] RBAC: Authorizing `identity:get_project(project_id=1e48b3f820a245a6b30e52d04bb892f7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:57.178492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7ba5e-3e83-425b-9d56-f3e7473ee103 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:57.180123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 577/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:01:57 2022] GET /identity/v3/projects/1e48b3f820a245a6b30e52d04bb892f7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:01:57.187150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:57.296983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ac75d-c600-4d51-9698-a0a7dc8f83c7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:57.332360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:57.333011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:57.333285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:57.333545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:57.334266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=1e48b3f820a245a6b30e52d04bb892f7, user.id=15a570df6fa94c29b0462891f50e6174) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:01:57.334566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:57.335987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd0293-18ae-4008-a867-07e504255370 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:57.337850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:57.343958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 584/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:01:57 2022] GET /identity/v3/role_assignments?user.id=15a570df6fa94c29b0462891f50e6174&scope.project.id=1e48b3f820a245a6b30e52d04bb892f7&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:01:59.295694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180f208-d6b4-47a7-a69e-5ed8897f88f8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:59.296438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180f208-d6b4-47a7-a69e-5ed8897f88f8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:59.296438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180f208-d6b4-47a7-a69e-5ed8897f88f8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:59.297672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 578/1162] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:01:59.302873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:59.303319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:59.303415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:59.322199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:01:59.323403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:01:59.396736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 585/1163] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:01:59.663844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180f208-d6b4-47a7-a69e-5ed8897f88f8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:01:59.773513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180f208-d6b4-47a7-a69e-5ed8897f88f8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:01:59.813267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:01:59.813870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:01:59.814143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:01:59.814406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:01:59.869302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:01:59.887325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:01:59.888940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:01:59.991458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 579/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:01:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:01:59.998055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:00.105825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af229d1-0c9d-410e-ae96-1ea8b2127960 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:00.135192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:00.144737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:00.145413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:00.145687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:00.145956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:00.152911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:00.154357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d2576644-a70b-440e-84af-2491ce02ef75 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:02:00.165813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:02:00.167866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:02:00.169620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 586/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:01:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:02:00.173262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:00.263007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:00.280148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3c235-d92f-44f1-92b6-fda894414060 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:00.317067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:00.317777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:00.317922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:00.318183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:00.318829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:00.319129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:00.320490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4508aa1-d41d-4dfd-9ed9-859bf105145d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:00.328311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 580/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Mon Aug 29 20:02:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:02:02.350044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87753e5-3d10-4ee8-9f2b-0705893666da None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:02.350657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87753e5-3d10-4ee8-9f2b-0705893666da None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:02.350657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87753e5-3d10-4ee8-9f2b-0705893666da None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:02.351957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 587/1167] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:02.358368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93ba0-2469-4b14-be37-2c6fad893c1a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:02.358972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93ba0-2469-4b14-be37-2c6fad893c1a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:02.358972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93ba0-2469-4b14-be37-2c6fad893c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:02.379566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6df93ba0-2469-4b14-be37-2c6fad893c1a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:02.380798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6df93ba0-2469-4b14-be37-2c6fad893c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:02.453756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 581/1168] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:02:02.726728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87753e5-3d10-4ee8-9f2b-0705893666da None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:02.838968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87753e5-3d10-4ee8-9f2b-0705893666da None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:02.875147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:02.875756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:02.876028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:02.876293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:02.877006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:02.878376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce5f4d-68d4-4a00-820a-4e8675414e40 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:02.895958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 588/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Mon Aug 29 20:02:02 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:02:04.852623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123ade-ae3a-460b-a357-f2a5181d0269 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:04.853406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123ade-ae3a-460b-a357-f2a5181d0269 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:04.853406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123ade-ae3a-460b-a357-f2a5181d0269 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:04.854595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 582/1170] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:04.860961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:04.861459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:04.861459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:04.880620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:04.881841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:04.928011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:04.956133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 589/1171] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:02:05.236152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52123ade-ae3a-460b-a357-f2a5181d0269 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:05.337101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:05.361405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52123ade-ae3a-460b-a357-f2a5181d0269 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:05.398705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:05.399402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:05.399747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:05.400061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] PATH_INFO: `/v3/domains/f3b9303c5a3947b6b4c30c437d3c2885` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:05.411311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=f3b9303c5a3947b6b4c30c437d3c2885)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:05.412775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24879f0b-6ff8-41d6-84ae-0453fcc08a2f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:05.414593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 583/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Mon Aug 29 20:02:05 2022] GET /identity/v3/domains/f3b9303c5a3947b6b4c30c437d3c2885 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:05.421386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:05.552629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75b30a-e399-4e4b-a698-4141cbea37c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:05.597584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:05.598251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:05.598528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:05.598800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:05.599460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:05.600939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d063205-e6b1-4376-bbe4-a47383c8b126 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:05.643200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 590/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:02:05 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:02:07.665025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991dcc-11a8-41c6-9c24-f064812426be None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:07.665615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991dcc-11a8-41c6-9c24-f064812426be None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:07.665615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991dcc-11a8-41c6-9c24-f064812426be None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:07.667133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 584/1174] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:07.673732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:07.674253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:07.674562 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:07.704068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:07.705307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:07.731901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:07.793255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 591/1175] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:02:08.084723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991dcc-11a8-41c6-9c24-f064812426be None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:08.200395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991dcc-11a8-41c6-9c24-f064812426be None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:08.246769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:08.247404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:08.247696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:08.247963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] PATH_INFO: `/v3/domains/f3b9303c5a3947b6b4c30c437d3c2885` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:08.249130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=f3b9303c5a3947b6b4c30c437d3c2885)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:08.250565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b01813-5802-4a20-81c7-aea94505ebbb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:08.252179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 585/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Mon Aug 29 20:02:08 2022] GET /identity/v3/domains/f3b9303c5a3947b6b4c30c437d3c2885 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:08.258501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:08.373143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff24a4-99c2-48ad-b9a8-331a3fc16061 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:08.413064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:08.413677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:08.413945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:08.414271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:08.414884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:08.416858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fc39e-0285-41be-95a5-b34f4e28780c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:08.441524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 592/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:02:08 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:02:10.417081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d067dc-7a1b-4246-b056-88aee185f348 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:10.417678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d067dc-7a1b-4246-b056-88aee185f348 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:10.417678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d067dc-7a1b-4246-b056-88aee185f348 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:10.418969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 586/1178] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:10.425173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:10.425625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:10.425773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:10.444982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:10.446130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:10.459662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:10.535559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 593/1179] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 20:02:10.802368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d067dc-7a1b-4246-b056-88aee185f348 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:10.812988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:10.912933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d067dc-7a1b-4246-b056-88aee185f348 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:10.948111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:10.948663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:10.948962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:10.949233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:10.960188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:02:10.965158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:02:10.966307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:02:10.967541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 587/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:02:10.972442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:11.074844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b49041-5360-45fd-a955-b7d82a6344a3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:11.111082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:11.111691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:11.111962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:11.112228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:11.112919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:11.113231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:11.114583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:11.123334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 594/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:11.129490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:11.195982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:11.234053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967358f2-3319-4539-a104-e8ab0e62161c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:11.272010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:11.272653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:11.272962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:11.273230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] PATH_INFO: `/v3/users/d5d1d0d4afb341b396ec930ecf1711be` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:11.287216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=d5d1d0d4afb341b396ec930ecf1711be)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:11.288666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:11.290435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 588/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:02:11 2022] GET /identity/v3/users/d5d1d0d4afb341b396ec930ecf1711be => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:11.296613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:11.308248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:11.399769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72895-534c-41c7-bc3e-d24f3fd4632b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:11.434693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:11.435361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:11.435560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:11.435824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:11.508346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:11.509830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:11.520006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:11.610034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 595/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:02:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:02:11.619488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:11.732668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715764b-9c1a-4184-bdf1-d7986d7ddbc5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:11.759590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:11.770895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:11.771536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:11.771810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:11.772079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] PATH_INFO: `/v3/projects/da4eef6f9a614f3ba39f79a65677752d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:11.773219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] RBAC: Authorizing `identity:get_project(project_id=da4eef6f9a614f3ba39f79a65677752d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:11.774812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589ffb8-9642-4bb7-aa88-d2083cc2ad0b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:11.776475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 589/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:02:11 2022] GET /identity/v3/projects/da4eef6f9a614f3ba39f79a65677752d => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:11.782949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:11.890679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776c652-0941-49e2-9070-8fdc5519f5ed None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:11.902012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:11.931731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:11.932411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:11.932695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:11.932996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:11.933733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=da4eef6f9a614f3ba39f79a65677752d, user.id=d5d1d0d4afb341b396ec930ecf1711be) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:11.934078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:11.935507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb63f1-104a-402b-bf42-2ca4be0f5ca9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:11.941667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 596/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:02:11 2022] GET /identity/v3/role_assignments?user.id=d5d1d0d4afb341b396ec930ecf1711be&scope.project.id=da4eef6f9a614f3ba39f79a65677752d&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:13.923697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fa6ae-6357-4f81-9fe9-6f0cde998cc8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:13.924256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fa6ae-6357-4f81-9fe9-6f0cde998cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:13.924256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fa6ae-6357-4f81-9fe9-6f0cde998cc8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:13.925575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 590/1186] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:13.932357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:13.932908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:13.932908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:13.953175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:13.954472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:14.039793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 597/1187] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:02:14.334095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fa6ae-6357-4f81-9fe9-6f0cde998cc8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:14.519829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fa6ae-6357-4f81-9fe9-6f0cde998cc8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:14.560183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:14.560836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:14.561110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:14.561376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:14.571852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:02:14.576578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:02:14.577745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:02:14.579050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 591/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:02:14.585114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:14.721134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6dd0b-d4df-4f29-9b73-48e7a4a9f708 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:14.722803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:14.774449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:14.775499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:14.775975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:14.776450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:14.777676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:14.778176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:14.780652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:14.791667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 598/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:02:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:02:14.797710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:14.855310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:14.909694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bb71a-ed7f-45df-beaf-ce95e2354b2c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:14.954635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:14.955449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:14.955747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:14.956014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] PATH_INFO: `/v3/users/d5d1d0d4afb341b396ec930ecf1711be` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:14.957545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] RBAC: Authorizing `identity:get_user(user_id=d5d1d0d4afb341b396ec930ecf1711be)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:14.958687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:14.960349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 592/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:02:14 2022] GET /identity/v3/users/d5d1d0d4afb341b396ec930ecf1711be => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:14.967105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:15.090815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece731e-5011-42e2-8fd4-0925b05d30a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:15.127465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:15.128003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:15.128269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:15.128531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] PATH_INFO: `/v3/projects/da4eef6f9a614f3ba39f79a65677752d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:15.129654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] RBAC: Authorizing `identity:get_project(project_id=da4eef6f9a614f3ba39f79a65677752d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:15.131084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a3738-ebd3-4030-b1bb-d5f039fe7700 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:15.132707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 599/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:02:14 2022] GET /identity/v3/projects/da4eef6f9a614f3ba39f79a65677752d => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:15.139412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:15.244101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c833-fb32-4765-9685-da0eeddc2577 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:15.267030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:15.282181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:15.282829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:15.283106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:15.283377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] PATH_INFO: `/v3/projects/da4eef6f9a614f3ba39f79a65677752d/users/d5d1d0d4afb341b396ec930ecf1711be/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:15.285394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] RBAC: Authorizing `identity:create_grant(project_id=da4eef6f9a614f3ba39f79a65677752d, user_id=d5d1d0d4afb341b396ec930ecf1711be, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:15.286872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71664a9-79da-4392-b0d1-68cb5062903c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:15.300982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 593/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:02:15 2022] PUT /identity/v3/projects/da4eef6f9a614f3ba39f79a65677752d/users/d5d1d0d4afb341b396ec930ecf1711be/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:02:17.320164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b95a-ca1b-4fbd-8136-ffb07b3e91ec None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:17.320792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b95a-ca1b-4fbd-8136-ffb07b3e91ec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:17.320792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6b95a-ca1b-4fbd-8136-ffb07b3e91ec None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:17.322366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 600/1193] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:02:17.328936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:17.329479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:17.329593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:17.351516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:02:17.353368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:02:17.437740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 594/1194] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:02:17.703728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6b95a-ca1b-4fbd-8136-ffb07b3e91ec None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:17.740041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:17.816013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6b95a-ca1b-4fbd-8136-ffb07b3e91ec None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:17.852092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:17.852921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:17.853195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:17.853463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:17.865481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:02:17.871052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:02:17.872455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:02:17.873505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 601/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:02:17.878648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:17.990870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c209bd-dfeb-4a55-acec-236ec634f35b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:18.004089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:18.034509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:18.035138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:18.035413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:18.035680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:18.036351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:18.036654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:18.038078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:18.048199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 595/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:02:18.054403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:18.164677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:18.175152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bea97-e8dc-4ade-b615-75bb97504ad5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:18.214156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:18.214156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:18.215117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:18.215260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] PATH_INFO: `/v3/users/d5d1d0d4afb341b396ec930ecf1711be` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:18.216411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] RBAC: Authorizing `identity:get_user(user_id=d5d1d0d4afb341b396ec930ecf1711be)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:18.217884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:18.219487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 602/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Mon Aug 29 20:02:18 2022] GET /identity/v3/users/d5d1d0d4afb341b396ec930ecf1711be => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:18.225833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:18.336409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d10e5e-b952-45b6-b7a3-e98f5759bd88 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:18.373425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:18.374039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:18.374308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:18.374571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:18.421648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:18.449176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:18.450636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:18.562885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 596/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:02:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:02:18.568970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:18.683312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f606a-1301-4401-9aaa-02559af0ae04 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:18.719578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:18.720215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:18.720484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:18.720797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] PATH_INFO: `/v3/projects/da4eef6f9a614f3ba39f79a65677752d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:18.721891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] RBAC: Authorizing `identity:get_project(project_id=da4eef6f9a614f3ba39f79a65677752d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:18.723325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e55536-de3c-4f44-b699-a72e6c91e55c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:18.725055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 603/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Mon Aug 29 20:02:18 2022] GET /identity/v3/projects/da4eef6f9a614f3ba39f79a65677752d => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:18.732661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:02:18.811896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:18.846230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b8bb-0d2e-4de5-ad10-09807fe815b7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:02:18.881917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:02:18.882818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:02:18.882818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:02:18.883112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:02:18.883913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=da4eef6f9a614f3ba39f79a65677752d, user.id=d5d1d0d4afb341b396ec930ecf1711be) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:02:18.883913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:02:18.885634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522e5c4-a281-4dbf-8bae-ab309ebf7b9c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:02:18.891883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 597/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:02:18 2022] GET /identity/v3/role_assignments?user.id=d5d1d0d4afb341b396ec930ecf1711be&scope.project.id=da4eef6f9a614f3ba39f79a65677752d&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:02:28.716810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:02:28.889062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=32 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:17.088270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98cef3-c549-4ca3-806e-b57638b7d38f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:17.088270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98cef3-c549-4ca3-806e-b57638b7d38f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:17.088270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98cef3-c549-4ca3-806e-b57638b7d38f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:17.088270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 604/1201] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:03:17.095576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:17.096722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:17.096722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:17.118558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:17.119959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:17.241057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 598/1202] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:17.543200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98cef3-c549-4ca3-806e-b57638b7d38f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:17.769187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98cef3-c549-4ca3-806e-b57638b7d38f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:17.836295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:17.837146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:17.837641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:17.838126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:17.855232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:17.858589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:17.886832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:17.887959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:17.888990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:17.888990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:17.888990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:17.888990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 605/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:17.896904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:18.059862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04994-a455-4c32-8493-7796055589e1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:18.106530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:18.114854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:18.115461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:18.115862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:18.116222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:18.117306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:18.117677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:18.119919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9278-f466-4bdc-9341-020cfd2b7495 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:18.140440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 599/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:18.147892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:18.242490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:18.310337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044895c-8fbb-4745-b1e1-141530895a89 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:18.365798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:18.367209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:18.367538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:18.367954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:18.368867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:18.370452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b9f8b-b6fd-4e11-a019-796827d988e3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:18.398179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 606/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Mon Aug 29 20:03:18 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:03:20.559068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54c60-3499-4d9f-8692-d500047e2c57 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:20.559746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54c60-3499-4d9f-8692-d500047e2c57 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:20.559746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb54c60-3499-4d9f-8692-d500047e2c57 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:20.561292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 600/1206] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:20.567530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:20.568067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:20.568067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:20.590538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:20.591810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:20.682458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 607/1207] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:20.958473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb54c60-3499-4d9f-8692-d500047e2c57 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:21.140769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb54c60-3499-4d9f-8692-d500047e2c57 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:21.184322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:21.185660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:21.185660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:21.185849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:21.202832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:21.208627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:21.209820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:21.210846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:21.211703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 601/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:21.219039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:21.266454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:21.356312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2627f-656c-4891-bb18-394caf1b6f03 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:21.410126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:21.410797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:21.411083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:21.411331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:21.412128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:21.412432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:21.414125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:21.423413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 608/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:03:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:21.429844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:21.501063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:21.579920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbef62-e414-45f4-9ca3-91d32421ddae None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:21.639642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:21.640507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:21.640919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:21.641278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:21.655994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:21.658032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:21.675138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:21.677210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:21.679893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:21.679893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:21.679893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:21.679893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 602/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:03:21.685098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:21.815952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:21.817224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd84bce-be7d-4619-8876-469576b0334f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:21.869979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:21.872679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:21.872679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:21.872679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:21.872679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:21.872679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:21.873601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:21.895768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 609/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:21.898785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:22.041695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7a30-511a-49ea-a0f1-5f466e162344 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:22.044903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:22.091595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:22.092170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:22.092454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:22.092719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:22.108044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:22.109873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:22.125614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:22.127671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:22.129739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 603/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:22.133029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:22.283224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c24fe-f712-413e-ad0b-906fca5a07b6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:22.330498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:22.331879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:22.334652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:22.334652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:22.334652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:22.335071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:22.338005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:22.369705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 610/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:22.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:22.519728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8a83-102b-4e8c-b96a-dcef509a5cb6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:22.565770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:22.566731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:22.567051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:22.567444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:22.617808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:22.673480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:22.675070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:22.825012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 604/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:03:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:03:22.826375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:22.849458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:22.986604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81b5d-f290-4b2c-8009-7350504302f5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:23.055010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:23.055876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:23.056241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:23.056582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:23.071430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:23.073595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:23.097583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:23.100644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:23.102200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:23.102200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:23.102200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:23.102200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 611/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:23.109377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:23.213192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:23.278794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52b59f-a7b5-47c2-97f8-054183958196 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:23.335774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:23.336435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:23.337097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:23.338602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:23.338777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:23.339079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:23.340711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:23.355548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 605/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:23.361788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:23.475129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:23.531203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a3443-ed40-4875-9835-0da66771a00b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:23.590108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:23.590762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:23.591037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:23.591306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:23.598662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:23.600247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:23.614810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:23.615965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:23.617335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:23.622026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:23.626172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 612/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:03:23.748998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679425a2-8d15-4b4e-8490-da7845d82e8c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:23.786462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:23.801362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:23.801988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:23.802251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:23.802617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:23.803357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:23.803757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:23.807018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65660c18-0016-4c2a-a300-2eafb77cdd85 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:23.832786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 606/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:23.841853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:24.012994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2b1cc-93f5-494c-898d-731c090fcd56 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:24.045078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:24.051834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:24.052514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:24.052938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:24.053362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:24.054678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=e661de36a7dc4a4b9e265fe10da1fad9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:24.055187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:24.057697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a1c89-e541-414f-b6d0-d843ef3610e9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:24.064266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 613/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:03:23 2022] GET /identity/v3/role_assignments?user.id=e661de36a7dc4a4b9e265fe10da1fad9&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:26.097038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22408-1c54-44e6-a738-2946271c250d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:26.097634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22408-1c54-44e6-a738-2946271c250d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:26.097634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22408-1c54-44e6-a738-2946271c250d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:26.098974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 607/1220] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:03:26.104795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:26.105379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:26.105379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:26.126919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:26.128139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:26.218043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 614/1221] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:26.510880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22408-1c54-44e6-a738-2946271c250d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:26.644575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22408-1c54-44e6-a738-2946271c250d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:26.691902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:26.692550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:26.692852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:26.693125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:26.707934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:26.713537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:26.718844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:26.720434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 608/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:26.721452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:26.851724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdf207-eb1c-4b9c-9b73-9f15483376d7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:26.886512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:26.901418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:26.902297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:26.902606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:26.902958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:26.903777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:26.904210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:26.906222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:26.917593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 615/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:26.923863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:26.981944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:27.055763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31c150-e495-4d8f-b225-63684c7151eb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:27.096961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:27.097662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:27.098339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:27.099710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:27.114724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:27.116441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:27.133710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:27.139754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:27.141399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:27.141399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:27.141399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:27.141399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 609/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:27.141828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:27.271664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcb8f5-dd40-4680-9c8a-c1878d15439e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:27.318570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:27.319609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:27.319899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:27.320234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:27.321019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:27.321667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:27.323099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:27.342401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 616/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:27.348161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:27.464403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:27.472995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccfd62-c504-496c-8436-030001e3fa2f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:27.515857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:27.516506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:27.516800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:27.517073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:27.525581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:27.527060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:27.539436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:27.541240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:27.542918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 610/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:27.546728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:27.608686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:27.675914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71a35-54bb-4c60-a0f3-ccbd847361fc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:27.722028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:27.722781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:27.723059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:27.723329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:27.724078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:27.724405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:27.727029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:27.750635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 617/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:27.756974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:27.895291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6464276-a2d3-4739-863b-d51db30f530d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:27.934044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:27.936763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:27.936763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:27.936763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:27.956065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:27.957797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:27.977366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:27.979385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:27.981434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:27.981434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:27.981434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:27.981434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 611/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:27.985183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:28.150571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8da5-d79c-421f-8814-0e50cff8d471 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:28.154704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:28.198189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:28.199165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:28.199606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:28.199999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:28.200895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:28.201389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:28.203537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:28.220602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 618/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:28.228095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:28.247906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:28.360492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb338ce-744b-4629-b46f-b4e5c5fe1135 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:28.398254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:28.398898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:28.399165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:28.399435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:28.406724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:28.408287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:28.426212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:28.428015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:28.429138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 612/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:28.434045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:28.560673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1458-f8cb-4b94-8a45-3e548fe63ba9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:28.602844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:28.603675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:28.604121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:28.604511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:28.605501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:28.605928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:28.607590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a1f03-9752-4898-9d0c-3c405ce8be9b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:28.627053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 619/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:28.634776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:28.736009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:28.787409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ebefc-4f56-4dc2-909d-62a9f27e624c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:28.830949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:28.831878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:28.832131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:28.832503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/e661de36a7dc4a4b9e265fe10da1fad9/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:28.851375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=e661de36a7dc4a4b9e265fe10da1fad9, role_id=8b6dbb1670ba4d7b83ff8c19fefdd3f9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:28.853051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527031a9-59ab-407b-b4c9-c40059a5d049 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:28.868489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 613/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:03:28 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/e661de36a7dc4a4b9e265fe10da1fad9/roles/8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:03:30.994428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898004-9f19-4b9c-8309-6c1816b1060c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:30.994986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898004-9f19-4b9c-8309-6c1816b1060c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:30.994986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898004-9f19-4b9c-8309-6c1816b1060c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:30.996256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 620/1233] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:31.001922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:31.002788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:31.002788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:31.023126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:31.024365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:31.118185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 614/1234] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:31.419858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3898004-9f19-4b9c-8309-6c1816b1060c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:31.449305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:31.581470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3898004-9f19-4b9c-8309-6c1816b1060c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:31.619528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:31.620166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:31.620431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:31.620699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:31.633940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:31.638828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:31.640057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:31.641042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 621/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Mon Aug 29 20:03:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:31.647137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:31.710464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:31.789391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cedf3f-9e1a-49be-b407-222af9d30ef7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:31.845048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:31.845669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:31.845955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:31.846216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:31.846944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:31.847225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:31.849160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:31.861699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 615/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Mon Aug 29 20:03:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:31.868931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:32.003201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:32.021959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f6f98-8ab2-4cf7-97ab-6d67c3f4fb33 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:32.062669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:32.063384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:32.063653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:32.063953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:32.079379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:32.081541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:32.102555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:32.104600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:32.106370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:32.106370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:32.106370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:32.106370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 622/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 20:03:32.111789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:32.245067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba113b8b-a9f7-40f4-9c9a-a51bc6eeea69 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:32.261600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:32.295573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:32.296455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:32.296844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:32.297253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:32.298020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:32.298558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:32.300254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:32.315002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 616/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:32.322170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:32.444965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34607db-ab6e-4dae-9373-592de368d645 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:32.488289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:32.489710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:32.490361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:32.490849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:32.495276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:32.503221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:32.504711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:32.522586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:32.524484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:32.526435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 623/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:32.530702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:32.655734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f7e0-f663-451d-a241-0c0ee02ea947 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:32.706216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:32.707088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:32.707088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:32.707088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:32.708113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:32.708476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:32.710129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:32.741378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 617/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:32.742657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:32.891948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746eb33-306d-4d2f-9ca3-37732281c533 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:32.931382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:32.932575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:32.933179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:32.933646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:33.013659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:33.024885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:33.028158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:33.179727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 624/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:03:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 20:03:33.181226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:33.217606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:33.311536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da160d-9745-4208-88b8-18f0291a28e8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:33.351539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:33.352182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:33.352458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:33.352722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:33.367648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:33.369702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:33.388919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:33.391458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:33.393616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:33.393616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:33.393616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:33.393616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 618/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:33.397837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:33.506952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:33.516707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a53244-7511-4086-9fc7-7117f69798b2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:33.562120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:33.562979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:33.563331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:33.563803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:33.564450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:33.564965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:33.564965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:33.584223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 625/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:33.590915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:33.701038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:33.729245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f075-c601-4e51-9234-4d641ff2b36c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:33.780968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:33.781548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:33.781818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:33.782083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:33.795687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:33.795687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:33.812115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:33.813296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:33.814408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 619/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:33.821462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:33.991435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f796d6-ba6e-4928-8590-ba9dfbb38472 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:34.049803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:34.050777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:34.050777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:34.051028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:34.051524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:34.051822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:34.054083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae92bc-c8fb-4093-b495-d2a04435e992 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:34.067926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 626/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:34.074801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:34.215701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bf713-3825-489a-9dfb-f201449f83ae None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:34.265418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:34.266273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:34.266643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:34.267031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:34.267768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] RBAC: Adding query filter params (role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=e661de36a7dc4a4b9e265fe10da1fad9) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:34.268078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:34.269730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234e70-0e8c-41b2-96de-00e243a646c1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:34.277318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 620/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:03:34 2022] GET /identity/v3/role_assignments?user.id=e661de36a7dc4a4b9e265fe10da1fad9&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=8b6dbb1670ba4d7b83ff8c19fefdd3f9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:36.556003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250442-a7bb-4066-9c97-3140e21d4769 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:36.556786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250442-a7bb-4066-9c97-3140e21d4769 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:36.556786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39250442-a7bb-4066-9c97-3140e21d4769 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:36.557954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 627/1247] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:36.565283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:36.566182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:36.566182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:36.575796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:36.590306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:36.591531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:36.678541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 621/1248] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:36.955093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39250442-a7bb-4066-9c97-3140e21d4769 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:36.979795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:37.096163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39250442-a7bb-4066-9c97-3140e21d4769 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:37.142987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:37.143977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:37.144425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:37.144908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:37.164695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:37.174165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:37.175305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:37.176320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 628/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:37.184527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:37.295510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04725b-7886-4963-80e6-74162f4c45c7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:37.338987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:37.344678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:37.345390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:37.345665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:37.346035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:37.346726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:37.347094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:37.348627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:37.359979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 622/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:37.366584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:37.454983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:37.481674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c18a-54dd-46b7-9dca-62ed47a1d2fc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:37.522777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:37.523388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:37.523663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:37.523934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:37.540204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:37.542848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:37.560685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:37.562379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:37.563503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:37.563503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:37.563503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:37.567043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 629/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:37.568894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:37.695901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf30f-f59a-4def-bc04-cbb1d8692b15 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:37.746949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:37.747707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:37.748133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:37.748133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:37.748780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:37.749061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:37.750485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:37.766145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 623/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:37.772508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:37.912148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248452-ff21-4b7d-8d7b-86afe0c3c0ed None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:37.940395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:37.950540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:37.951408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:37.951684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:37.953306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:37.961833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:37.963287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:37.975302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:37.977200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:37.979197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 630/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:37.982515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:38.059734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:38.116658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349dea5-c567-4f11-998b-f2f10851df22 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:38.171623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:38.172288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:38.172288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:38.172288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:38.175677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:38.175677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:38.175677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:38.195521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 624/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:38.201548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:38.321326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b575-ba56-45e8-8356-fdfd2fe2e4e1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:38.361879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:38.362496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:38.362769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:38.363034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:38.432438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:38.447865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:38.449359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:38.572484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 631/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:03:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:03:38.578632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:38.709794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d237a-e7d4-4939-9732-af3f639656d7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:38.734444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:38.763353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:38.763969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:38.764244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:38.764518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:38.778695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:38.780779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:38.805413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:38.807695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:38.810032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:38.810032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:38.810032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:38.810032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 625/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:38.812775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:38.954001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:38.970437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37003a64-b387-47ac-a73c-795bae83ea5f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:39.012822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:39.013409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:39.013659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:39.014020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:39.014557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:39.014860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:39.016222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:39.031542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 632/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:39.041400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:39.172946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e292c52-e084-4d82-bcaa-10d61d96d306 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:39.222090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:39.222651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:39.222935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:39.223204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:39.230882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:39.232357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:39.252473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:39.253592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:39.254640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 626/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:39.260192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:39.382598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d0fdc-2c1d-41d9-a2d1-66b6c56188f1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:39.421131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:39.421788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:39.422083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:39.422363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:39.423098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:39.423395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:39.424876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b0a02-827a-4468-b5f1-13bef31de515 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:39.439131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 633/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:03:39.445859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:39.475402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:39.577663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ebedf-97ed-4b5d-9df1-0c044f5e23c4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:39.629097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:39.630314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:39.630314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:39.630583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:39.631198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=e661de36a7dc4a4b9e265fe10da1fad9) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:39.631554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:39.633161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54617-9780-417c-82fe-9687c118adb8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:39.640041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 627/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:03:39 2022] GET /identity/v3/role_assignments?user.id=e661de36a7dc4a4b9e265fe10da1fad9&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:41.579509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5c4b-9b89-4c0f-9620-f6eb2c11d288 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:41.580075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5c4b-9b89-4c0f-9620-f6eb2c11d288 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:41.580075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5c4b-9b89-4c0f-9620-f6eb2c11d288 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:41.581432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 634/1261] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:41.589733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:41.590241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:41.590661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:41.610863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:41.612662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:41.692052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 628/1262] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:41.969568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e5c4b-9b89-4c0f-9620-f6eb2c11d288 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:41.980805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:42.081153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e5c4b-9b89-4c0f-9620-f6eb2c11d288 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:42.119310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:42.119949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:42.120221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:42.120485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:42.131293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:42.136087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:42.137250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:42.138467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:42.140937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 635/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:03:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:42.143316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:42.163870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:42.251245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef167-1bf8-4eca-938a-3efa547c45ce None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:42.288238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:42.288921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:42.289197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:42.289465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:42.290142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:42.290440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:42.291842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:42.301320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 629/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:42.307906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:42.382792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:42.431991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db7cfe-be2b-4442-a559-e6e8ac228e4c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:42.468201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:42.468851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:42.469121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:42.469389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:42.481033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:42.486673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:42.503557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:42.504688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:42.505972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:42.505972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:42.505972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:42.505972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 636/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:42.510994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:42.602318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:42.622064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ab8f-9661-4927-b46f-5474b731a952 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:42.661620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:42.662355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:42.662626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:42.662899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:42.663601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:42.663858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:42.665319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:42.679310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 630/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:42.684860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:42.820367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ba17-215d-450f-80cb-6240ceade46d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:42.841548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:42.856387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:42.857065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:42.857335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:42.857602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:42.866172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:42.867615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:42.879218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:42.880369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:42.881423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 637/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:42.886940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:42.996609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dfd30-858f-478b-90ab-18e4d32b3c10 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.033389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.034002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.034278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.034543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.035279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:43.035584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.037353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.046725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:43.057403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 631/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:43.063295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:43.169147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526209ef-ceb5-48e4-893a-0def414b9926 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.205498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.206153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.206423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.206690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.218467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.219903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:43.234534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:43.235733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:43.236667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:43.236667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:43.236667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:43.236667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 638/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:43.242282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:43.345884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4836b5-5529-43c6-9f0d-c0858573d796 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.384661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.385304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.385581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.385846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.386490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:43.386792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.388181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.400490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 632/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:43.406476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:43.446318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:43.520992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824d1b-4265-4e6f-b184-07665d1c79a1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.556845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.557478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.557744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.558003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.565782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.567206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:43.578689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:43.579677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:43.580667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 639/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:43.586062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:43.647637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:43.695438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d145f-a01f-4b94-83cd-872d10ee92b1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.731422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.731945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.732227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.732495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.733219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:43.733537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.735018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb37bd-b0a0-4950-b45b-ba1711fcaa8a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.748432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 633/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:43.754715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:43.861551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:43.877201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30a9e6-a1cb-4dc1-9ec4-65ae686bfc0a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:43.912655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:43.913359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:43.913636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:43.913909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] PATH_INFO: `/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/e661de36a7dc4a4b9e265fe10da1fad9/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:43.915982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ba72fb3f45b46698dfaca936fb2c5ec, user_id=e661de36a7dc4a4b9e265fe10da1fad9, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:43.917540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f79e12-3e02-4c4c-994e-7419bc97dca6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:43.936865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 640/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Mon Aug 29 20:03:43 2022] PUT /identity/v3/projects/7ba72fb3f45b46698dfaca936fb2c5ec/users/e661de36a7dc4a4b9e265fe10da1fad9/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:03:45.865851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616378-776d-404f-8e85-28cbdbcf3f57 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:45.866402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616378-776d-404f-8e85-28cbdbcf3f57 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:45.866402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b616378-776d-404f-8e85-28cbdbcf3f57 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:45.867733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 634/1274] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:45.873457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:45.873950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:45.874050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:45.893769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:45.894992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:45.968253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 641/1275] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:46.239378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b616378-776d-404f-8e85-28cbdbcf3f57 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:46.351463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b616378-776d-404f-8e85-28cbdbcf3f57 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:46.370589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:46.389523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:46.390166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:46.390443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:46.390714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:46.401733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 20:03:46.406515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:46.407608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:46.408805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 635/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Mon Aug 29 20:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:46.414259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:46.500932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:46.522970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40998201-950e-4ff4-81d1-b6bec5571611 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:46.559974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:46.560582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:46.560882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:46.561146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:46.561807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:46.562096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:46.563444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:46.572281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 642/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Mon Aug 29 20:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:46.578100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:46.686350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dfeb5-04b6-41b6-bad3-1c361568a185 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:46.722513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:46.723140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:46.723394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:46.723728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:46.734562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:46.736013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:46.751949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:46.753206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:46.754547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:46.754547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:46.754547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:46.756979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 636/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:46.759470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:46.874008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f1ed3-948a-432a-ac92-f344c198c54c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:46.909305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:46.909922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:46.910192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:46.910459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:46.911246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:46.911663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:46.913023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:46.925126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 643/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:46.931637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:46.964762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:47.039151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c12bb7-51c5-48a3-8e59-564aa1278b6d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:47.074607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:47.075264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:47.075538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:47.075802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:47.084651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:47.085879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 20:03:47.098159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:47.099539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:47.100874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 637/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:47.106606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:47.111061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:47.220378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c642b-d240-4160-9ea5-d504bb562b64 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:47.257165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:47.257767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:47.258046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:47.258315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:47.259058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:47.259355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:47.260792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:47.278613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 644/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Mon Aug 29 20:03:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:47.284869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:47.383020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:47.394250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9fcfd-ae37-448b-a03b-3a4f6e0c12bc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:47.432172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:47.432810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:47.433086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:47.433349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:47.511977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:47.513486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:47.631287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:47.650029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 638/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Mon Aug 29 20:03:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 20:03:47.656682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:47.733755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:47.782294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76cad-43b2-427a-9ca4-56583306fb32 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:47.818527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:47.819188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:47.819503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:47.819818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:47.831480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:47.833120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 20:03:47.850000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:47.851199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 20:03:47.852143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 20:03:47.852143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 20:03:47.852143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:47.852143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 645/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:47.858072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:47.967379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7d378-c197-4dcf-999a-e2fd35662390 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:48.002973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:48.003581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:48.003849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:48.004105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:48.004926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:48.005279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:48.006657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:48.018754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 639/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Mon Aug 29 20:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:48.025250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:48.133076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75350-d2f9-4051-b41e-824c5047dfda None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:48.149186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:48.171631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:48.172365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:48.172637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:48.172929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:48.180565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:48.182045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 20:03:48.193527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:48.194777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 20:03:48.196774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 646/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Mon Aug 29 20:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:48.202377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:48.260177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:48.322456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5937-48ec-4104-aa45-1c97be801ace None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:48.357507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:48.358118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:48.358396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:48.358666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:48.359361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:48.359668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:48.361176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9c84c-b55b-45a5-93fe-8e139e3c593d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:48.374095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 640/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Mon Aug 29 20:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:48.381108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:48.503244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5dd5-1bad-4dfd-81cd-bd5776753efc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:48.541615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:48.542130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:48.542400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:48.542694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:48.543383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] RBAC: Adding query filter params (role.id=911a5bcd4e504f538aeb3869289f542b, scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec, user.id=e661de36a7dc4a4b9e265fe10da1fad9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:48.543681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:48.545136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4452a-b70e-46df-aaf7-1ab60108bfd2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:48.551337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 647/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Mon Aug 29 20:03:48 2022] GET /identity/v3/role_assignments?user.id=e661de36a7dc4a4b9e265fe10da1fad9&scope.project.id=7ba72fb3f45b46698dfaca936fb2c5ec&role.id=911a5bcd4e504f538aeb3869289f542b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:50.513009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28039fa3-03d1-4dd7-87bc-74ac242972b2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:50.513605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28039fa3-03d1-4dd7-87bc-74ac242972b2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:50.513605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28039fa3-03d1-4dd7-87bc-74ac242972b2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:50.514892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 641/1288] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:50.520353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:50.520925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:50.521077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:50.541753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:50.542943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:50.574202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:50.619100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 648/1289] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:50.901834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28039fa3-03d1-4dd7-87bc-74ac242972b2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:51.010507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28039fa3-03d1-4dd7-87bc-74ac242972b2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:51.022115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:51.047814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:51.048446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:51.048723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:51.049019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:51.049603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:51.051007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:51.060526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:51.061923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:51.063006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 642/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:03:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:51.068268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:51.175461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12688-fbfe-4410-9a63-beed3479b8d7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:51.211136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715982bd-da10-414f-a708-c255122311e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:51.211744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982bd-da10-414f-a708-c255122311e6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:51.212014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982bd-da10-414f-a708-c255122311e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:51.212279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715982bd-da10-414f-a708-c255122311e6 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:51.212942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715982bd-da10-414f-a708-c255122311e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:51.213239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715982bd-da10-414f-a708-c255122311e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:51.214596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715982bd-da10-414f-a708-c255122311e6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:51.219815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 649/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Aug 29 20:03:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:51.227145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:51.340233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69654900-a8ee-42c1-b55f-41cadb764609 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:51.376303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:51.376939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:51.377211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:51.377472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:51.378099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:51.378398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:51.379822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3647-0cf6-47a4-8803-e9be86847b75 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:51.384800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 643/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Aug 29 20:03:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:53.300178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d4971-a07a-4345-82c9-e1c34ace2964 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:53.300796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d4971-a07a-4345-82c9-e1c34ace2964 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:53.300796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d4971-a07a-4345-82c9-e1c34ace2964 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:53.302230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 650/1293] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:53.309002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd604ec-0ca5-43e8-bc60-7fe8d153d78a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:53.309747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd604ec-0ca5-43e8-bc60-7fe8d153d78a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:53.309747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd604ec-0ca5-43e8-bc60-7fe8d153d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:53.328303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-dcd604ec-0ca5-43e8-bc60-7fe8d153d78a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:53.329622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dcd604ec-0ca5-43e8-bc60-7fe8d153d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:53.362850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:53.402595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 644/1294] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:53.669746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d4971-a07a-4345-82c9-e1c34ace2964 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:53.703347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:53.783271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d4971-a07a-4345-82c9-e1c34ace2964 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:53.822436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:53.823048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:53.823318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:53.823585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:53.824231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:53.825630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31bbdc-3347-41b3-9601-84d0bc82bec6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:53.845339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 651/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Mon Aug 29 20:03:53 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:03:55.840536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4aca-112c-4a94-8007-e37d39dd9677 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:55.841276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4aca-112c-4a94-8007-e37d39dd9677 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:55.841276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b4aca-112c-4a94-8007-e37d39dd9677 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:55.842655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 645/1296] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:03:55.848434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:55.849243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:55.849524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:55.870084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:55.871278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:55.949439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 652/1297] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:56.211511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4aca-112c-4a94-8007-e37d39dd9677 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:56.320491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b4aca-112c-4a94-8007-e37d39dd9677 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:56.357964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:56.358628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:56.358898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:56.359159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:56.359756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:56.361181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:56.372091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:56.376838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:56.377995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 646/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:03:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:56.379840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:56.400037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:56.487399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3ee21-0114-4b3c-b10f-2c5b71af865d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:56.522169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:56.522855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:56.523129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:56.524274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:56.525011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:56.525303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:56.526670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:56.531986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 653/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Aug 29 20:03:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:56.538452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:56.576943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:56.651701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a762-0918-456d-87b7-0b2cac78b678 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:56.690937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:56.691553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:56.691989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:56.692277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:56.693009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] RBAC: Adding query filter params (interface=public, service_id=e56bed3400c341c5b218d4694a8c3034, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:56.693314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:56.694682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebad3b-52c9-4e9f-a05c-2859bd5d1a96 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:56.700223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 647/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Mon Aug 29 20:03:56 2022] GET /identity/v3/endpoints?service_id=e56bed3400c341c5b218d4694a8c3034&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:56.706217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:56.810970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:56.833326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39458b5d-3770-4915-be26-3d99701dcc55 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:56.870749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:56.871541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:56.871640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:56.871862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:56.872541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:56.873869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74ac05-2c30-4007-96ac-6d36f71d4634 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:56.881122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 654/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Mon Aug 29 20:03:56 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:03:58.805430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4417096-26bb-40a7-af74-5fc4c367db6b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:58.806259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4417096-26bb-40a7-af74-5fc4c367db6b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:58.806259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4417096-26bb-40a7-af74-5fc4c367db6b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:58.807307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 648/1302] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:03:58.812702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:58.813193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:58.813304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:58.832047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:03:58.833631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:03:58.906934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 655/1303] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:03:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 20:03:59.170961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4417096-26bb-40a7-af74-5fc4c367db6b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:59.274292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:59.284261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4417096-26bb-40a7-af74-5fc4c367db6b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:59.326387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:59.327112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:59.327394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:59.327679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:59.328353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:59.330169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 20:03:59.341084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 20:03:59.342332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 20:03:59.343366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 649/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Mon Aug 29 20:03:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 20:03:59.349409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:59.434422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:03:59.459299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542edfd-e58c-48b3-b488-4a02c3298c28 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:59.495631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:59.496240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:59.496516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:59.496809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:59.497447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:03:59.497750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:59.499124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e5195-dfa4-44f9-a4dd-2c9fcd8d05ca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:59.504387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 656/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Mon Aug 29 20:03:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:03:59.510646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:03:59.620512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf61aae-dea4-4925-a8d2-b74f648201b6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:03:59.656444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:03:59.657086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:03:59.657360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:03:59.657631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:03:59.658322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:03:59.659712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897424-8da2-4eef-9794-f65929eeb7d5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:03:59.681459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 650/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:03:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:04:09.501723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=30 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:04:09.677093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:10.814939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8daf3-0619-40bf-b51c-8a67facbdeae None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:10.815786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8daf3-0619-40bf-b51c-8a67facbdeae None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:10.815786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8daf3-0619-40bf-b51c-8a67facbdeae None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:10.817455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 657/1307] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:10.822985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660066-0369-4a36-a00e-ec581ef9f596 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:10.823872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660066-0369-4a36-a00e-ec581ef9f596 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:10.824294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660066-0369-4a36-a00e-ec581ef9f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:10.926776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-71660066-0369-4a36-a00e-ec581ef9f596 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:10.928207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71660066-0369-4a36-a00e-ec581ef9f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:11.073314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 651/1308] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:11.381120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:11.381788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:11.382557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:11.386131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 658/1309] 10.222.0.61 () {54 vars in 965 bytes} [Mon Aug 29 20:05:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:11.396045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b2d7-d322-4607-bf19-6b6d915a9cef None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:11.396642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b2d7-d322-4607-bf19-6b6d915a9cef None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:11.397196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b2d7-d322-4607-bf19-6b6d915a9cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:11.559403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2338b2d7-d322-4607-bf19-6b6d915a9cef None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:11.562553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2338b2d7-d322-4607-bf19-6b6d915a9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:11.605258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:11.728052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 652/1310] 10.222.0.61 () {58 vars in 1062 bytes} [Mon Aug 29 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:11.739093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:11.740921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:11.960403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726b0f-3588-4f80-b601-8f4b8c659932 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:12.124324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:12.125386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:12.125834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:12.126389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:12.129485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:12.242431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:12.364278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:12.367111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680e61-cd2e-4fa4-9eeb-75e51e9a6fc9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:12.406668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 659/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:05:15.121033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:15.121712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:15.121994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:15.124478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 653/1312] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:15.132847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb059a-7da9-4608-82c1-60fb091c6e16 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:15.133493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb059a-7da9-4608-82c1-60fb091c6e16 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:15.133493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb059a-7da9-4608-82c1-60fb091c6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:15.244471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-57fb059a-7da9-4608-82c1-60fb091c6e16 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:15.246211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-57fb059a-7da9-4608-82c1-60fb091c6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:15.383253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 660/1313] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:15.736733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:15.739576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:15.950955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770f94a-8369-439f-bb59-91d21d8bb5c0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:16.079912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:16.086955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:16.087935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:16.088703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:16.089174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:16.092206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:16.313753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:16.317542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b17e-e9d6-488d-aa36-0ec515a9d79f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:16.355248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 654/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:05:18.930865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d8f-6700-4055-9c63-967650e0388e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:18.931478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d8f-6700-4055-9c63-967650e0388e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:18.931478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0d8f-6700-4055-9c63-967650e0388e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:18.932713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 661/1315] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:18.938721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d140b7-79ca-46bc-9f87-17561d4773fc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:18.939794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d140b7-79ca-46bc-9f87-17561d4773fc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:18.939794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d140b7-79ca-46bc-9f87-17561d4773fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:19.018588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b4d140b7-79ca-46bc-9f87-17561d4773fc None None] MFA Rules not processed for user `8415463a9ba0463aa60cc65278d679e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:19.019835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b4d140b7-79ca-46bc-9f87-17561d4773fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:19.075115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:19.133583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 655/1316] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:19.432964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:19.433299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:19.433491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:19.434881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 662/1317] 10.222.0.61 () {54 vars in 965 bytes} [Mon Aug 29 20:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:19.442065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6122c-d643-4425-9fb7-5f58bc3cf394 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:19.442351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6122c-d643-4425-9fb7-5f58bc3cf394 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:19.442622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6122c-d643-4425-9fb7-5f58bc3cf394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:19.529660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3fb6122c-d643-4425-9fb7-5f58bc3cf394 None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:19.530873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3fb6122c-d643-4425-9fb7-5f58bc3cf394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:19.621254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 656/1318] 10.222.0.61 () {58 vars in 1062 bytes} [Mon Aug 29 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:19.631737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:19.633370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:19.645056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:19.754898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9532e6-5bac-4ff1-8d1f-2721957ff2a4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:19.839413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:19.840079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:19.840387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:19.840694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:19.842445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:19.911523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:19.961780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:19.963151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983cc6e-ea22-46bc-99ea-be783348996c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:19.981567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 663/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:22.953011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:22.954023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:22.954023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:22.955393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 657/1320] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:22.961724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede73e3-ad3a-42e8-9596-041050aa4215 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:22.962379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede73e3-ad3a-42e8-9596-041050aa4215 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:22.962379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede73e3-ad3a-42e8-9596-041050aa4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:23.038253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ede73e3-ad3a-42e8-9596-041050aa4215 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:23.039477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ede73e3-ad3a-42e8-9596-041050aa4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:23.151644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 664/1321] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:23.440011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:23.441701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:23.497415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:23.555510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978c6b7-415c-476b-9ac9-33b91e4adbbc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:23.631732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:23.632349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:23.632620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:23.632911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:23.634529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:23.746061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:23.760924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:23.762605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced302b1-1947-43b4-8c0d-be656a802924 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:23.781830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 658/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:26.604609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:26.605432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:26.605432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:26.606732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 665/1323] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:05:26.630378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ef441-a2ea-464b-bf51-2ef001674100 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:26.630977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ef441-a2ea-464b-bf51-2ef001674100 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:26.631327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ef441-a2ea-464b-bf51-2ef001674100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:26.720324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-294ef441-a2ea-464b-bf51-2ef001674100 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:26.721959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-294ef441-a2ea-464b-bf51-2ef001674100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:26.883260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 659/1324] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:27.220185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:27.222114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:27.258675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:27.400445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dea433-e735-4962-812e-3e49d17a04ef None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:27.506782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:27.507311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:27.507582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:27.507841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:27.509537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:27.603911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:27.654701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:27.656186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e57612-5fd6-4a1f-b910-b05abfd57ff4 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:27.681300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 666/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:05:29.797916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:29.798784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:29.799040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:29.800542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 660/1326] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:29.806989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f3d4-c683-4c6a-868b-5509bfb7d998 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:29.807520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f3d4-c683-4c6a-868b-5509bfb7d998 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:29.807651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158f3d4-c683-4c6a-868b-5509bfb7d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:29.892990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7158f3d4-c683-4c6a-868b-5509bfb7d998 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:29.894449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7158f3d4-c683-4c6a-868b-5509bfb7d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:30.015017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 667/1327] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:30.300524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:30.302972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:30.378674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:30.433546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91beba-936c-48ce-b727-59d1dc16b46e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:30.545202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:30.545831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:30.546225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:30.546701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:30.549522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:30.691936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:30.695151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:30.697046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411543-205b-4fe6-bdc8-193611ae6f7e service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:30.719632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 661/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:32.970197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:32.970929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:32.970929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:32.972773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 668/1329] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:32.978627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b866-9f39-401c-9ac4-0d09d7808255 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:32.979202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b866-9f39-401c-9ac4-0d09d7808255 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:32.979202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b866-9f39-401c-9ac4-0d09d7808255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:33.060949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9e11b866-9f39-401c-9ac4-0d09d7808255 None None] MFA Rules not processed for user `8415463a9ba0463aa60cc65278d679e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:33.062264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9e11b866-9f39-401c-9ac4-0d09d7808255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:33.178896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 662/1330] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:05:33.466098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:33.467760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:33.510501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:33.596950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85547954-f19a-45e9-9a8a-43e185105abc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:33.690467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:33.691220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:33.691541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:33.691877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:33.695634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:33.825566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:33.873077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:33.874619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6d27-a11c-4fff-8205-50ff594d7611 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:33.900669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 669/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:36.637763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:36.638345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:36.638345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:36.639733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 663/1332] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:36.645871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa14df-795b-4306-9529-5989a5a9bc2c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:36.646484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa14df-795b-4306-9529-5989a5a9bc2c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:36.646484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa14df-795b-4306-9529-5989a5a9bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:36.723836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-12aa14df-795b-4306-9529-5989a5a9bc2c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:36.725075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12aa14df-795b-4306-9529-5989a5a9bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:36.834692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 670/1333] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:37.119397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:37.120956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:37.197247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:37.233164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c29d-663e-4470-aad2-2ac1ee35c484 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:37.317372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:37.318002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:37.318281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:37.318551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:37.320198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:37.475959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:37.477570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8e0b-ec6d-4e9e-a1be-d46c6a5590ad service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:37.489508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:37.498936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 664/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:39.525537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:39.526430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:39.526430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:39.528220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 671/1335] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:39.537011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e37d-461f-4449-ad5a-b31680195607 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:39.538058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e37d-461f-4449-ad5a-b31680195607 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:39.538058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e37d-461f-4449-ad5a-b31680195607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:39.617954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-de67e37d-461f-4449-ad5a-b31680195607 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:39.619195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-de67e37d-461f-4449-ad5a-b31680195607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:39.737217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 665/1336] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:40.027728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:40.029404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:40.088834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:40.172703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874b280-3d02-4172-ba42-3d47e668ef34 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:40.273502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:40.274032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:40.274304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:40.274571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:40.276290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:40.392084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:40.425380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:40.426841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407511d-4eb0-4e5f-ba77-0d72f4107144 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:40.448215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 672/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:43.199194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:43.200091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:43.200091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:43.202638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 666/1338] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:43.212677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a72-f24f-4a34-bee6-899e85d18dc3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:43.213529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a72-f24f-4a34-bee6-899e85d18dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:43.213529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e2a72-f24f-4a34-bee6-899e85d18dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:43.314020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7e0e2a72-f24f-4a34-bee6-899e85d18dc3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:43.315624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e0e2a72-f24f-4a34-bee6-899e85d18dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:43.454065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 673/1339] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:05:43.772457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:43.774143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:43.863576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:43.899113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9bb2-885f-48ec-978e-752176d77a43 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:43.988449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:43.989110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:43.989384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:43.989656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:43.991287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:44.109541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:44.111489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cabf8-8cb4-4686-8ceb-365320f79e07 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:44.132002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 667/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:48.781027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:48.782100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:48.782100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:48.783813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 674/1341] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:05:48.792804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55786-4261-4244-9b15-2fc1405b683e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:48.793827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55786-4261-4244-9b15-2fc1405b683e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:48.793827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55786-4261-4244-9b15-2fc1405b683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:48.801689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:48.906959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-12c55786-4261-4244-9b15-2fc1405b683e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:48.908815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-12c55786-4261-4244-9b15-2fc1405b683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:49.062897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 668/1342] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:05:49.353769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:49.355297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:49.418593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:49.510998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee2ee2-4d49-4772-b648-ad6e187b4054 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:49.619592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:49.620212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:49.620534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:49.620894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:49.622842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:49.754090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:49.773765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:49.775192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fdf3e-272d-45c2-bfc5-e8629608f0fd service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:49.798628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 675/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:52.539310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:52.540193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:52.540193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:52.541243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 669/1344] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:05:52.546920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f257-887b-45a9-a388-63f2a2aee230 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:52.547947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f257-887b-45a9-a388-63f2a2aee230 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:52.547947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f257-887b-45a9-a388-63f2a2aee230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:52.628006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-50a4f257-887b-45a9-a388-63f2a2aee230 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:52.630484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-50a4f257-887b-45a9-a388-63f2a2aee230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:52.794517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 676/1345] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:05:53.223574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:53.225783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:53.384004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:53.416972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5e5f8-98c5-411e-967f-c4d9f844992f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:53.534020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:53.534769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:53.535187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:53.535596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:53.537705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:53.703292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:53.704828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30f902-21fc-40c6-810c-22dfa697cb95 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:53.742558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 670/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:05:58.405128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:58.405913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:58.405913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:58.407297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 677/1347] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:05:58.413664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098416d-bdcc-4fa5-9776-ae3af6bef49c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:58.414565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098416d-bdcc-4fa5-9776-ae3af6bef49c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:58.414565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098416d-bdcc-4fa5-9776-ae3af6bef49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:58.431985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:58.515911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3098416d-bdcc-4fa5-9776-ae3af6bef49c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:05:58.517982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3098416d-bdcc-4fa5-9776-ae3af6bef49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:58.685367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 671/1348] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:05:58.963212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:05:58.965087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:59.040598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:59.107739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f238ddf-e3a0-45a8-aed9-2643fbec1f2a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:05:59.199961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:05:59.200582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:05:59.200955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:05:59.201236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:05:59.203448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:05:59.355030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:05:59.360898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:05:59.362615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6debb3-5bcf-4057-aa04-1de5217ead48 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:05:59.384853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 678/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:04.904018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1a8b-a5e2-4bd2-bfcd-46c01c19e34b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:04.904892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1a8b-a5e2-4bd2-bfcd-46c01c19e34b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:04.904892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1a8b-a5e2-4bd2-bfcd-46c01c19e34b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:04.906222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 672/1350] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:04.913654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a22cb-9b89-4657-83f2-3873fb94ac43 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:04.914316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a22cb-9b89-4657-83f2-3873fb94ac43 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:04.914616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a22cb-9b89-4657-83f2-3873fb94ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:05.045241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-030a22cb-9b89-4657-83f2-3873fb94ac43 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:05.046502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-030a22cb-9b89-4657-83f2-3873fb94ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:05.251298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 679/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:08.669133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=59 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:10.020327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c15974-31f7-411d-bf6a-058328c1be04 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.021003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c15974-31f7-411d-bf6a-058328c1be04 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.021251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c15974-31f7-411d-bf6a-058328c1be04 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.022686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 673/1352] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:10.028043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe653a2-596d-4e5f-84b9-b6f2feb15e93 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:10.028957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe653a2-596d-4e5f-84b9-b6f2feb15e93 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:10.029444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe653a2-596d-4e5f-84b9-b6f2feb15e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:10.092223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:10.119524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9fe653a2-596d-4e5f-84b9-b6f2feb15e93 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:10.120780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9fe653a2-596d-4e5f-84b9-b6f2feb15e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:10.275044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 680/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:06:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:11.831340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665fbbf-9292-4c43-b32d-22f6b08991c8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:11.831916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665fbbf-9292-4c43-b32d-22f6b08991c8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:11.832010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665fbbf-9292-4c43-b32d-22f6b08991c8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:11.833506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 674/1354] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:11.839619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d678c9e-0e2d-44ee-ae25-6c9105362a43 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:11.840148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d678c9e-0e2d-44ee-ae25-6c9105362a43 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:11.840148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d678c9e-0e2d-44ee-ae25-6c9105362a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:11.941421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5d678c9e-0e2d-44ee-ae25-6c9105362a43 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:11.942690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5d678c9e-0e2d-44ee-ae25-6c9105362a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:11.991620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:12.067813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 681/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:06:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:15.299534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5af1-5c15-47ec-8d11-06b991233a10 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:15.300596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5af1-5c15-47ec-8d11-06b991233a10 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:15.300596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed5af1-5c15-47ec-8d11-06b991233a10 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:15.301606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 675/1356] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:06:15.307541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778ed1-d34b-4e88-b29c-d12cde46a342 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:15.308201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778ed1-d34b-4e88-b29c-d12cde46a342 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:15.308201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0778ed1-d34b-4e88-b29c-d12cde46a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:15.383831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e0778ed1-d34b-4e88-b29c-d12cde46a342 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:15.385096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0778ed1-d34b-4e88-b29c-d12cde46a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:15.526051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 682/1357] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:15.848737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:15.849802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:15.850406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:15.852023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 676/1358] 10.222.0.61 () {54 vars in 962 bytes} [Mon Aug 29 20:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:15.862929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87e05-d676-4afe-8f8b-00ede8319e25 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:15.863696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87e05-d676-4afe-8f8b-00ede8319e25 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:15.865037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec87e05-d676-4afe-8f8b-00ede8319e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:15.888649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:16.006366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-eec87e05-d676-4afe-8f8b-00ede8319e25 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:16.008672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eec87e05-d676-4afe-8f8b-00ede8319e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:16.232511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 683/1359] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Aug 29 20:06:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:16.241447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:16.243253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:16.425849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4148f-e747-4c61-937b-eddfd45fe771 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:16.526535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:16.585125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:16.585930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:16.586305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:16.586713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:16.588597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:16.717005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:16.718924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c1db1-1eb4-4bc6-8371-f0d06ad41c02 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:16.743099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 677/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:19.256202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.257141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.257141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.258268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 684/1361] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:19.263721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32476-f361-4bcf-aa05-2a5d58fd6604 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:19.264210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32476-f361-4bcf-aa05-2a5d58fd6604 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:19.264483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32476-f361-4bcf-aa05-2a5d58fd6604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:19.348139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6fc32476-f361-4bcf-aa05-2a5d58fd6604 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:19.350551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fc32476-f361-4bcf-aa05-2a5d58fd6604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:19.426673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:19.508794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 678/1362] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:19.822470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:19.823987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:19.947015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.072789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512a3a7-ebe6-4f7b-9c94-d152ad936588 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:20.239155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:20.240302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:20.240869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:20.241419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:20.244626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:20.289722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:20.422452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:20.425841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1f3c7-4027-4740-b7b2-4072ba0c450a service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:20.453550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 685/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:22.922409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6034f-3c58-4939-9751-eec20e333e69 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:22.923099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6034f-3c58-4939-9751-eec20e333e69 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:22.923099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6034f-3c58-4939-9751-eec20e333e69 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:22.925031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 679/1364] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:22.930826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d86c-e9c5-428d-a1b3-c32b2320710e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:22.931359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d86c-e9c5-428d-a1b3-c32b2320710e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:22.931359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d86c-e9c5-428d-a1b3-c32b2320710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.013003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f048d86c-e9c5-428d-a1b3-c32b2320710e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:23.014441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f048d86c-e9c5-428d-a1b3-c32b2320710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:23.119433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:23.122600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 686/1365] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:23.430557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.430986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.431362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.433227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 680/1366] 10.222.0.61 () {54 vars in 962 bytes} [Mon Aug 29 20:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:23.441012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e6d-dbac-4b4d-b0f7-62ef638026d4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:23.441590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e6d-dbac-4b4d-b0f7-62ef638026d4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:23.441964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e6d-dbac-4b4d-b0f7-62ef638026d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:23.546803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e9bd3e6d-dbac-4b4d-b0f7-62ef638026d4 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:23.548095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9bd3e6d-dbac-4b4d-b0f7-62ef638026d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:23.713384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 687/1367] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Aug 29 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:23.722742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:23.724735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:23.931754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ce45c-5910-4722-a904-a51f9381b492 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:23.957589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:24.063747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:24.064787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.065260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.065725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.068091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:24.188165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:24.190560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5df21-d0d6-4a97-9927-5c16cae7929e service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:24.215528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 681/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:06:24.309558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf21-2f62-47a2-ab3f-2e473b59a50d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.310767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf21-2f62-47a2-ab3f-2e473b59a50d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.310767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86faf21-2f62-47a2-ab3f-2e473b59a50d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.312130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 688/1369] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:24.317624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef723ae-f7c8-466c-8bdc-ffd551f2df3b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:24.318512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef723ae-f7c8-466c-8bdc-ffd551f2df3b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:24.318512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef723ae-f7c8-466c-8bdc-ffd551f2df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:24.360691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:24.408084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bef723ae-f7c8-466c-8bdc-ffd551f2df3b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:24.409524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bef723ae-f7c8-466c-8bdc-ffd551f2df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:24.534444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 682/1370] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:25.088336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:25.088588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:25.088864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:25.090514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 689/1371] 10.222.0.61 () {54 vars in 964 bytes} [Mon Aug 29 20:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:25.096068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c44f-7d35-4255-8256-4263f3d70ed0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:25.096664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c44f-7d35-4255-8256-4263f3d70ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:25.096664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855c44f-7d35-4255-8256-4263f3d70ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:25.194348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c855c44f-7d35-4255-8256-4263f3d70ed0 None None] MFA Rules not processed for user `4fa74e5d2adb4da1afcecdb718be98f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:25.195578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c855c44f-7d35-4255-8256-4263f3d70ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:25.257293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:25.300924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 683/1372] 10.222.0.61 () {58 vars in 1061 bytes} [Mon Aug 29 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:25.305146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:25.306858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:25.364595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:25.425383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1f8b-ba34-4e67-a677-9da018bea252 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:25.520135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:25.521234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:25.521517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:25.521791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:25.523668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:25.779180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:25.799100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:25.800937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3500d-50f9-4a5d-9b2a-6b783da724ca service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:25.829660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 690/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:26.293135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:26.293701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:26.293701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:26.295031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 684/1374] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:26.300708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e66b-7b45-4f3e-9baf-7a49ff3780cc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:26.301033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e66b-7b45-4f3e-9baf-7a49ff3780cc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:26.301308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e66b-7b45-4f3e-9baf-7a49ff3780cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:26.381015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b390e66b-7b45-4f3e-9baf-7a49ff3780cc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:26.382368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b390e66b-7b45-4f3e-9baf-7a49ff3780cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:26.485934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 691/1375] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:26.772861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:26.774669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:26.935995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fb1c5-f5d7-462e-95c1-17aee911072a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:26.993014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:27.063820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:27.065051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:27.065325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:27.065620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:27.067254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:27.165860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:27.167470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb8820-2549-4b0d-b923-69b6b4e22661 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:27.190358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 685/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:29.388457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:29.389262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:29.389439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:29.391342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 692/1377] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:29.399367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a6ef-3f42-450d-8b4e-11e9a0edb773 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:29.399367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a6ef-3f42-450d-8b4e-11e9a0edb773 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:29.399367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a6ef-3f42-450d-8b4e-11e9a0edb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:29.526423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-dce6a6ef-3f42-450d-8b4e-11e9a0edb773 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:29.527708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dce6a6ef-3f42-450d-8b4e-11e9a0edb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:29.540898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:29.673508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 686/1378] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:30.013924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:30.016139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:30.111807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:30.257730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a5f1f-60a4-4451-af4a-eca0497cb3f1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:30.445570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:30.446632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:30.446632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:30.446632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:30.448149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:30.479255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:30.576734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:30.578349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc999e1-6d62-49fe-9faa-4d91f145c603 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:30.603096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 693/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:33.318781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.319720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.319720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.322375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 687/1380] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:33.331601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072350-b2da-43ab-9189-86148d222a56 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:33.332213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072350-b2da-43ab-9189-86148d222a56 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:33.332519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072350-b2da-43ab-9189-86148d222a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:33.469875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f5072350-b2da-43ab-9189-86148d222a56 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:33.472307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f5072350-b2da-43ab-9189-86148d222a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:33.637955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:33.669379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 694/1381] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:34.135813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:34.137550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:34.349949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.371938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf46e-1a7e-4ca0-a9f0-b024235afffb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:34.610997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:34.612267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:34.612713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:34.613308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:34.616486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:34.801868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:34.803575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789b685-8fc7-4b75-9806-d472aa906e31 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:34.817016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:34.828895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 688/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:37.491517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.492057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.492057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.493809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 695/1383] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:37.502234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ab12-23cd-4b0a-9734-173fbf5424e5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:37.503135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ab12-23cd-4b0a-9734-173fbf5424e5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:37.503846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3ab12-23cd-4b0a-9734-173fbf5424e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:37.637237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d5a3ab12-23cd-4b0a-9734-173fbf5424e5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:37.640653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d5a3ab12-23cd-4b0a-9734-173fbf5424e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:37.798310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 689/1384] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:38.103059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:38.105449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:38.315691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dbb47-3eaf-43dc-90a3-682c2c6d4119 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:38.416619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:38.477243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:38.478045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:38.478460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:38.479106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:38.480539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:38.603985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:38.606437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07a450-1808-438f-88c2-fd8a62f025d4 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:38.634229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 696/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:40.923153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.924267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.924267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:40.925396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 690/1386] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:40.932058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac3f-742b-4724-bfd8-0b29aa7c7dde None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:40.932058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac3f-742b-4724-bfd8-0b29aa7c7dde None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:40.933190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67ac3f-742b-4724-bfd8-0b29aa7c7dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.021450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2d67ac3f-742b-4724-bfd8-0b29aa7c7dde None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:41.023080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2d67ac3f-742b-4724-bfd8-0b29aa7c7dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:41.062621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.149227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 697/1387] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:41.478016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:41.479632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:41.581561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.683611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9da620-b676-43d4-a8dd-a66825931bb2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:41.815700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:41.816404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:41.816788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:41.817065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:41.818897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:41.865377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:41.930756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:41.932415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a0b74-cec2-4fd8-8a3b-4399b3341e8d service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:41.954328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 691/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:43.032714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c549-07ff-4b2a-b869-39456e16d84e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.033580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c549-07ff-4b2a-b869-39456e16d84e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.033580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c549-07ff-4b2a-b869-39456e16d84e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.034951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 698/1389] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:43.040730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4290b-3d03-4eae-8755-5e9f3b08e40b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.041230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4290b-3d03-4eae-8755-5e9f3b08e40b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.041335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4290b-3d03-4eae-8755-5e9f3b08e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.118936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2fc4290b-3d03-4eae-8755-5e9f3b08e40b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:43.120166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2fc4290b-3d03-4eae-8755-5e9f3b08e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:43.237260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 692/1390] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:43.541454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.541837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.542170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.543761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 699/1391] 10.222.0.61 () {54 vars in 967 bytes} [Mon Aug 29 20:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:43.548593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3db6-addf-4c12-9406-6011586b1f29 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.549028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3db6-addf-4c12-9406-6011586b1f29 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.549296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d3db6-addf-4c12-9406-6011586b1f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.565661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.631534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-419d3db6-addf-4c12-9406-6011586b1f29 None None] MFA Rules not processed for user `b756232a28874eba8520a100216a156a`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:43.632780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-419d3db6-addf-4c12-9406-6011586b1f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:43.722395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 693/1392] 10.222.0.61 () {58 vars in 1064 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:43.730278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:43.731877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:43.853953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a213b-568d-4dfd-9eaa-82df25c47a9c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:43.920183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:43.939938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:43.941143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.941143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.941424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.943101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:43.991790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e01599-4de1-4a9b-9cd3-695834621575 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:43.992601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e01599-4de1-4a9b-9cd3-695834621575 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:43.993113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e01599-4de1-4a9b-9cd3-695834621575 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:43.995396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 694/1393] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:44.001538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9ba16-46eb-47ce-8a32-3bad8fa58f52 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.002489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9ba16-46eb-47ce-8a32-3bad8fa58f52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.002988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9ba16-46eb-47ce-8a32-3bad8fa58f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.073452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.074951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.077774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3ef9ba16-46eb-47ce-8a32-3bad8fa58f52 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:44.079041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3ef9ba16-46eb-47ce-8a32-3bad8fa58f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:44.100847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 700/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:44.146066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.196488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 695/1395] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:44.487344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:44.489025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:44.598729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.607775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642dfff-1a48-42cc-b1a8-d5564280c6c9 service glance] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:44.766425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:44.766989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.767252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.767589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.774428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:44.920330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb10a-10cf-40ba-87a9-a6a5fbeff9bf None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:44.920628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:44.920839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb10a-10cf-40ba-87a9-a6a5fbeff9bf None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:44.920996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb10a-10cf-40ba-87a9-a6a5fbeff9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:44.922350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8cca3-c4de-4843-bec1-030e11caec11 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:44.942271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:44.947892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 701/1396] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:45.002652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d1abb10a-10cf-40ba-87a9-a6a5fbeff9bf None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:45.003682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d1abb10a-10cf-40ba-87a9-a6a5fbeff9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:45.122418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 696/1397] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:06:45.174356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:45.175256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:45.175256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:45.177575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 702/1398] 10.222.0.61 () {54 vars in 943 bytes} [Mon Aug 29 20:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:45.186005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a242bf-008d-469d-a3cf-e5c2fafd366b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:45.186405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a242bf-008d-469d-a3cf-e5c2fafd366b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:45.186771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a242bf-008d-469d-a3cf-e5c2fafd366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:45.276984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:45.302820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-11a242bf-008d-469d-a3cf-e5c2fafd366b None None] MFA Rules not processed for user `746f454bf6df48378388ac7372961998`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:45.304214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-11a242bf-008d-469d-a3cf-e5c2fafd366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:45.440653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 697/1399] 10.222.0.61 () {58 vars in 1040 bytes} [Mon Aug 29 20:06:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:45.451728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:45.454446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:45.666101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551118a8-498f-4f95-a5ad-ff383b24ab4c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:45.792071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:45.829819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:45.830868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:45.831338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:45.831776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:45.834943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:45.952702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:45.955719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b663b-ff77-4b49-b856-e8de7a30569f service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:45.971825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 703/1400] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:06:47.007916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.008800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.008800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.010649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 698/1401] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:47.016635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7656-7089-4188-82ed-f54d59110003 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:47.017504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7656-7089-4188-82ed-f54d59110003 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:47.017504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7656-7089-4188-82ed-f54d59110003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:47.125042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-88bd7656-7089-4188-82ed-f54d59110003 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:47.127424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-88bd7656-7089-4188-82ed-f54d59110003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:47.244976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:47.305253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 704/1402] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:06:47.636993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:47.638523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:47.828014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:47.919927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8597bc5-9e1f-406e-9a86-b5b3f9ae0dfa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:48.088959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:48.089685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:48.089935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:48.090715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:48.092209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:48.210325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:48.236399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:48.238391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77ad5f-0165-42ae-9018-8789c0551ee3 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:48.263632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 699/1403] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:06:50.572932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.573992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.574359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.575965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 705/1404] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:50.581716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ad46-c458-4f6c-82ab-fa09502046c4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:50.582322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ad46-c458-4f6c-82ab-fa09502046c4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:50.582322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5ad46-c458-4f6c-82ab-fa09502046c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:50.680231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-62b5ad46-c458-4f6c-82ab-fa09502046c4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:50.681775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-62b5ad46-c458-4f6c-82ab-fa09502046c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:50.886507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 700/1405] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:06:51.202640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:51.204490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:51.436552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead12db-9292-4d84-9968-9a9149120414 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:51.545178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:51.651697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:51.652821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:51.652821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:51.653113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:51.654595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:51.785663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:51.787844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410d0a5-b9ad-497f-8806-eaa2f08e9331 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:51.820121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 706/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:06:54.692203 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.693096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.693096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.694619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 701/1407] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:06:54.702898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bbf4-eef6-4f31-92a1-a92762b6c559 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:54.703788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bbf4-eef6-4f31-92a1-a92762b6c559 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:54.703788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bbf4-eef6-4f31-92a1-a92762b6c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:54.790239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2fa5bbf4-eef6-4f31-92a1-a92762b6c559 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:06:54.792131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2fa5bbf4-eef6-4f31-92a1-a92762b6c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:54.809848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:54.938618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 707/1408] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:06:55.397649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:06:55.400706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:55.492082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:55.705075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3aa20-9f7e-48bc-b01a-41e9be79b549 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:06:55.911915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:06:55.912664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:06:55.913052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:06:55.913422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:06:55.915855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:06:55.934390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:06:56.108169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:06:56.110890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1cf0e-6284-431f-a6a9-e080b4bce1c2 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:06:56.137731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 702/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:04.936860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=37 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:06.134837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=41 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:13.894458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba622081-f93a-42fd-bf52-312ac7f16b30 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.895314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba622081-f93a-42fd-bf52-312ac7f16b30 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.895314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba622081-f93a-42fd-bf52-312ac7f16b30 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:13.897098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 708/1410] 10.222.0.61 () {54 vars in 918 bytes} [Mon Aug 29 20:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:13.903753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221029ca-5f4b-4a16-8817-344143b6d86a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:13.904285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221029ca-5f4b-4a16-8817-344143b6d86a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:13.904285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221029ca-5f4b-4a16-8817-344143b6d86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.013749 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-221029ca-5f4b-4a16-8817-344143b6d86a None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:14.014987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-221029ca-5f4b-4a16-8817-344143b6d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:14.147848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 703/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Aug 29 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:14.165250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2026ea-3309-4bce-beef-5a051ea96a7a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.165715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2026ea-3309-4bce-beef-5a051ea96a7a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.166156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2026ea-3309-4bce-beef-5a051ea96a7a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.168313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 709/1412] 10.222.0.61 () {54 vars in 918 bytes} [Mon Aug 29 20:07:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:14.174141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e75ab-8a3d-4979-9641-2f99d47cbe12 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:14.174414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e75ab-8a3d-4979-9641-2f99d47cbe12 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:14.174745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e75ab-8a3d-4979-9641-2f99d47cbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:14.271129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:14.275954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3f2e75ab-8a3d-4979-9641-2f99d47cbe12 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:14.278109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3f2e75ab-8a3d-4979-9641-2f99d47cbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:14.433169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 704/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Aug 29 20:07:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:17.423403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.424771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.425252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.427535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:17.433743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333981-cc40-462a-be44-992defb0bf84 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:17.434596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333981-cc40-462a-be44-992defb0bf84 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:17.434596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333981-cc40-462a-be44-992defb0bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:17.533027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9a333981-cc40-462a-be44-992defb0bf84 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:17.535264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9a333981-cc40-462a-be44-992defb0bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:17.632314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:17.689100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:18.043499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:18.045528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:18.299926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b21d-b919-43f2-8279-e3037432f2f5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:18.412071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:18.465840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:18.466653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:18.466768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:18.466964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:18.468581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:18.585174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:18.586603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc74da-cc74-4b84-bbe2-71cf6c6f2d8e service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:18.607530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 711/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:19.617794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177537-182e-4f23-a340-d08262d83106 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.618530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177537-182e-4f23-a340-d08262d83106 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.618865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177537-182e-4f23-a340-d08262d83106 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.621356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:19.627996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999be51-6b4a-42a4-b272-fb0f9677787c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:19.628687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999be51-6b4a-42a4-b272-fb0f9677787c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:19.629946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999be51-6b4a-42a4-b272-fb0f9677787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:19.741831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f999be51-6b4a-42a4-b272-fb0f9677787c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:19.743774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f999be51-6b4a-42a4-b272-fb0f9677787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:19.794491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:19.902603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:20.097921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177537-182e-4f23-a340-d08262d83106 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:20.099698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f4177537-182e-4f23-a340-d08262d83106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:20.358902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177537-182e-4f23-a340-d08262d83106 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:20.419131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:20.540070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:20.540690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:20.540994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:20.541261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:20.542954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:20.665697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:20.667873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c0d92-17f7-4a1e-84a9-f1e6ecd43aef service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:20.690406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 707/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:21.654890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.655541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.655541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.656883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:21.665176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0c9a-d2f4-4d9b-9de8-8202a78644eb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:21.665509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0c9a-d2f4-4d9b-9de8-8202a78644eb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:21.665837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0c9a-d2f4-4d9b-9de8-8202a78644eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:21.733409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:21.762686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bc8a0c9a-d2f4-4d9b-9de8-8202a78644eb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:21.763956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bc8a0c9a-d2f4-4d9b-9de8-8202a78644eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:21.893145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:22.052291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:22.055187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:22.270069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f42c-2529-4476-b190-b2d35b102403 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:22.284071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:22.432671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:22.433335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:22.433613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:22.433876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:22.435560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:22.561771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:22.563478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032303d-47b0-40a9-9f87-fefd272eca43 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:22.588523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 714/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:23.698489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.699350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.699350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.700996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:23.707640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a561-e9e8-4d9a-9c97-8074ee403be1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:23.708285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a561-e9e8-4d9a-9c97-8074ee403be1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:23.708577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a561-e9e8-4d9a-9c97-8074ee403be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:23.745351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:23.821339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e3f6a561-e9e8-4d9a-9c97-8074ee403be1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:23.822590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e3f6a561-e9e8-4d9a-9c97-8074ee403be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:23.963690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:24.124010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:24.126263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:24.306955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.372677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e202f-7e78-4220-8a6b-35e6b417eaff None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:24.532688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:24.533466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:24.533847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:24.534331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:24.536673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:24.682819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:24.708935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:24.712084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a987492-58ea-40a5-afc3-778cbb25f0ed service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:24.746685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 710/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:25.693618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.694236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.694578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.697015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:25.706225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8bb7-cc74-493d-b947-03f587a015bb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:25.706632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8bb7-cc74-493d-b947-03f587a015bb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:25.707133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d8bb7-cc74-493d-b947-03f587a015bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:25.841160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-237d8bb7-cc74-493d-b947-03f587a015bb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:25.842425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-237d8bb7-cc74-493d-b947-03f587a015bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:25.996806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:26.293711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:26.295287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:26.452203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.572976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd66723-1d6a-4f7a-bc39-6164fc4cb0c8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:26.767219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:26.768233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:26.769406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:26.769887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:26.773070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:26.865979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:26.927101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:26.929517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588aab-75b7-44df-9006-818234707a9f service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:26.953986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 717/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:28.349659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.350581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.350581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.352587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:28.359774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817782-fef5-4891-8539-2a97683ac97f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:28.360331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817782-fef5-4891-8539-2a97683ac97f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:28.360331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51817782-fef5-4891-8539-2a97683ac97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:28.461321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-51817782-fef5-4891-8539-2a97683ac97f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:28.462568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-51817782-fef5-4891-8539-2a97683ac97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:28.590155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:28.785844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:28.788031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:28.850238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:28.977951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052e397-cf57-40e6-8812-95f10b817326 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:29.119614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:29.120416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:29.120696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:29.121117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:29.123318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:29.133660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:29.239188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:29.240696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aa2fb-1549-4e2f-9b13-4b9808ec8a82 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:29.265979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 713/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:30.212277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.213068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.213068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.217492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:30.223982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bd88-bd35-4e16-8c41-60cc03010565 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:30.224687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bd88-bd35-4e16-8c41-60cc03010565 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:30.224687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77bd88-bd35-4e16-8c41-60cc03010565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:30.368789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0e77bd88-bd35-4e16-8c41-60cc03010565 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:30.371080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0e77bd88-bd35-4e16-8c41-60cc03010565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:30.483742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.527413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:30.687363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:30.689101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:30.711175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:30.889744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fe0cb-688a-41a5-90f7-f2595cb70cef None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:31.026064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:31.066294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:31.067011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:31.067343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:31.067643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:31.069382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:31.198782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:31.200456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2c57-8c89-496a-b3c5-273407d2d23b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:31.223676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 720/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:32.237650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.238330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.238330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.239997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:07:32.245937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90576e7-110a-484d-82e1-840b95a5623a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:32.246809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90576e7-110a-484d-82e1-840b95a5623a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:32.246809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90576e7-110a-484d-82e1-840b95a5623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:32.356632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f90576e7-110a-484d-82e1-840b95a5623a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:32.357982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f90576e7-110a-484d-82e1-840b95a5623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:32.416298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:32.487892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:32.656942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:32.658537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:32.897126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef5808-3dd5-4caf-bc4d-c4501553cc50 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:32.968631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:33.079191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:33.080235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:33.080687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:33.081296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:33.086523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:33.265010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:33.267130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34f76e-f583-4d3d-9f9b-5fcffa77d30f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:33.292255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 716/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:34.517649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.518247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.518247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.519746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:34.528847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a50-2fa4-42a4-9f93-9463f61c2f09 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:34.529584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a50-2fa4-42a4-9f93-9463f61c2f09 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:34.529788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6a50-2fa4-42a4-9f93-9463f61c2f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:34.673132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7ebe6a50-2fa4-42a4-9f93-9463f61c2f09 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:34.675094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7ebe6a50-2fa4-42a4-9f93-9463f61c2f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:34.678400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:34.832138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:34.993241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:34.994885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:35.227951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b39ae-5787-4966-ab78-433e7635f67a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:35.270947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:35.400495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:35.401268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:35.401605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:35.401969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:35.403886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:35.544926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:35.546459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8ccc-1ade-425e-8c64-24ff88c2bcda service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:35.573005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 723/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:37.675744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.676582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.677037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.678696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:37.685879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e227e-76bc-490c-bd96-3a94588ee25a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:37.686494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e227e-76bc-490c-bd96-3a94588ee25a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:37.686668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e227e-76bc-490c-bd96-3a94588ee25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:37.750106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:37.784881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e60e227e-76bc-490c-bd96-3a94588ee25a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:37.785949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e60e227e-76bc-490c-bd96-3a94588ee25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:37.941348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:38.283638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:38.286487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:38.443808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f9ec0-d70b-484d-9fe6-8f13cdf6472c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:38.499698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:38.560738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:38.561469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:38.561934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:38.562265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:38.564460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:38.740359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:38.741949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf62eb-5d76-48c0-8c47-daed5c20f2c0 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:38.770896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 719/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:42.294762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.295315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.295618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.298187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:42.306884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcd02-450a-4039-9e38-dffdbe639f5a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:42.307701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcd02-450a-4039-9e38-dffdbe639f5a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:42.307701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbcd02-450a-4039-9e38-dffdbe639f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:42.419927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f4cbcd02-450a-4039-9e38-dffdbe639f5a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:42.422095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f4cbcd02-450a-4039-9e38-dffdbe639f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:42.448243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:42.613867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:42.902699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:42.904283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:43.031102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403d09-26f3-42c9-a451-f5b57e79257d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:43.044489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:43.137399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:43.138045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:43.138316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:43.138577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:43.140360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:43.322166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:43.324906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e745f41-1c77-49f0-9961-b30f20ec3c71 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:43.354746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 726/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:46.032453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.033144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.033144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.034485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:46.043024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156718-06fa-41f2-84ce-e86db86930fb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:46.043879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156718-06fa-41f2-84ce-e86db86930fb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:46.043879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156718-06fa-41f2-84ce-e86db86930fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:46.126721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:46.165034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-83156718-06fa-41f2-84ce-e86db86930fb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:46.166633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-83156718-06fa-41f2-84ce-e86db86930fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:46.326480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:46.656716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:46.658307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:46.869661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55df728-1d46-4c3b-ba01-f2dd3fca15fa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:46.942875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:47.004007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:47.005110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:47.005110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:47.005648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:47.007031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:47.157260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:47.158764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa71c-85b6-4c1a-9c9b-7269adbe0de1 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:47.180125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 722/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:07:49.311462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.312182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.312182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.313575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:49.321161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e9ef-38db-44c5-86ce-ecd675047f11 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:49.321816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e9ef-38db-44c5-86ce-ecd675047f11 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:49.321999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e9ef-38db-44c5-86ce-ecd675047f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:49.421953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1727e9ef-38db-44c5-86ce-ecd675047f11 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:49.423264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1727e9ef-38db-44c5-86ce-ecd675047f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:49.451218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:49.559900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:49.877026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:49.878688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:50.026547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c600a48-1447-4218-a93d-5113f8841916 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:50.051529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:50.134929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:50.135627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:50.135907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:50.136179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:50.137912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:50.264847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:50.266487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae05a8-f792-4b5f-8666-3153e11a803b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:50.295201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 729/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:52.482183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.482802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.482802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.484386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:52.491014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38441-1c09-412c-b471-70fc2ac9510f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:52.491843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38441-1c09-412c-b471-70fc2ac9510f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:52.492008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38441-1c09-412c-b471-70fc2ac9510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:52.570100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:52.573538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8af38441-1c09-412c-b471-70fc2ac9510f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:52.576263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8af38441-1c09-412c-b471-70fc2ac9510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:52.695470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:07:53.024446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:53.027246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:53.232463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d69e23-6634-4618-a0b1-d934bdff3b51 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:53.315359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:53.361739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:53.363318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:53.363806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:53.364405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:53.367704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:53.529297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:53.530783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffd9ae-88c4-407d-933e-277b90634ffd service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:53.553788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 725/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:55.737456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.738614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.738614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.740266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:55.747487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1bac5-0444-4caa-8310-30f06a1e35db None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:55.748102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1bac5-0444-4caa-8310-30f06a1e35db None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:55.748460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1bac5-0444-4caa-8310-30f06a1e35db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:55.873689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c1e1bac5-0444-4caa-8310-30f06a1e35db None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:55.875721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c1e1bac5-0444-4caa-8310-30f06a1e35db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:55.931509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.055122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:56.390485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:56.392649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:56.544381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae128ee0-33fb-48be-bd6a-d5a78ab55631 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:07:56.589285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:56.663536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:07:56.664498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:56.664918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:56.665297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:56.667728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:56.839969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:07:56.841556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35432b2f-e588-434c-ac26-9e925f1a18e6 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:07:56.865309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 732/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:07:59.345353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.346006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.346006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.347585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:07:59.353743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee14-3b58-4100-bcfa-bdd1fb27cbf7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:07:59.354373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee14-3b58-4100-bcfa-bdd1fb27cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:07:59.354373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ee14-3b58-4100-bcfa-bdd1fb27cbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:07:59.435152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-26b6ee14-3b58-4100-bcfa-bdd1fb27cbf7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:07:59.436403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-26b6ee14-3b58-4100-bcfa-bdd1fb27cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:59.446344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:07:59.547090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:07:59.834525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:07:59.836970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:07:59.963980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910fc5-1a22-4cf7-b486-6768ead472bb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:00.039084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:00.065437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:00.066051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:00.066324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:00.066673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:00.068429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:00.218587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:00.219974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cb722-3e9b-443f-a976-45c3ad22ccdc service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:00.241186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 728/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:02.534710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.535578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.535954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.538521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:08:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:02.544561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eda9-c321-4bfa-a73b-d5903878ffee None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:02.545193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eda9-c321-4bfa-a73b-d5903878ffee None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:02.545193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75eda9-c321-4bfa-a73b-d5903878ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:02.623156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1f75eda9-c321-4bfa-a73b-d5903878ffee None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:02.624392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1f75eda9-c321-4bfa-a73b-d5903878ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:02.669706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:02.738562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:03.025598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:03.027151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:03.194138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c983f5-3799-4614-b93a-2892f7d4d46d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:03.246171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:03.291577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:03.292101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:03.292375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:03.292640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:03.294363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:03.460418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:03.461928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590da43-c5fa-4057-8ba2-444578da2eed service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:03.483403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 735/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:05.518464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.519396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.519396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.520721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:05.527986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e775-f1c5-44ab-a50a-72bf64b86b02 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:05.528532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e775-f1c5-44ab-a50a-72bf64b86b02 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:05.529004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e775-f1c5-44ab-a50a-72bf64b86b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:05.642749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3fa1e775-f1c5-44ab-a50a-72bf64b86b02 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:05.644033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fa1e775-f1c5-44ab-a50a-72bf64b86b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:05.665466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:05.758870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:06.056031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:06.057652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:06.180166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab887bf-4a84-45c5-9911-ffee0dbea523 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:06.267733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:06.278804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:06.279359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:06.279654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:06.279987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:06.281839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:06.457305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:06.458782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b351-23ac-479f-9841-9948f815c9e1 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:06.479189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 731/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:08.549466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.550374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.550374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.551416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:08.558861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19cb80-2693-4e6c-865a-98c5ce1aacb6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:08.559450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19cb80-2693-4e6c-865a-98c5ce1aacb6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:08.559836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19cb80-2693-4e6c-865a-98c5ce1aacb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:08.655100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3b19cb80-2693-4e6c-865a-98c5ce1aacb6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:08.656396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3b19cb80-2693-4e6c-865a-98c5ce1aacb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:08.721003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:08.778861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:09.071495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:09.073354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:09.199129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad319-d46f-49d0-894c-4f8790ad3038 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:09.262280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:09.302887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:09.303508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:09.303791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:09.304059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:09.305788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:09.479813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:09.482753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821732d-e4d4-40da-992b-d2c80b70fb3a service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:09.523132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 738/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:08:18.777149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=22 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:19.517378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=66 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:32.187097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e352d8-96bd-49b7-bff9-036ac70928f8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.188010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e352d8-96bd-49b7-bff9-036ac70928f8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.188010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e352d8-96bd-49b7-bff9-036ac70928f8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.189234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 733/1471] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:32.197352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481db0-2d9c-4637-b8b7-236cc727f958 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.198175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481db0-2d9c-4637-b8b7-236cc727f958 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.198368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481db0-2d9c-4637-b8b7-236cc727f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.283091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d8481db0-2d9c-4637-b8b7-236cc727f958 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:32.284353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8481db0-2d9c-4637-b8b7-236cc727f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:32.469982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 739/1472] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:32.878192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.878541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.878914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:32.880499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 734/1473] 10.222.0.61 () {54 vars in 967 bytes} [Mon Aug 29 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:32.886145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89af1e-ca97-4752-b3ed-0569696ad695 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:32.886469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89af1e-ca97-4752-b3ed-0569696ad695 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:32.886796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89af1e-ca97-4752-b3ed-0569696ad695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.035449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c89af1e-ca97-4752-b3ed-0569696ad695 None None] MFA Rules not processed for user `b756232a28874eba8520a100216a156a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:33.037719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c89af1e-ca97-4752-b3ed-0569696ad695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:33.073546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.171553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 740/1474] 10.222.0.61 () {58 vars in 1064 bytes} [Mon Aug 29 20:08:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:33.184728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:33.187525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:33.397835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935097f9-de46-47cc-8503-4a2f8d34f743 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:33.515316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:33.516017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:33.516395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:33.516781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:33.518766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:33.616187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:33.707085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:33.708963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa77eb-72f0-4a8f-b8ea-3bb57699eb14 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:33.741914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 735/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:36.276822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.277862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.278947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.284596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 741/1476] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:36.294742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d79c2-b57a-4dc0-896a-fad3b2a9918c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:36.295404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d79c2-b57a-4dc0-896a-fad3b2a9918c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:36.295655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d79c2-b57a-4dc0-896a-fad3b2a9918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:36.423389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a53d79c2-b57a-4dc0-896a-fad3b2a9918c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:36.425310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a53d79c2-b57a-4dc0-896a-fad3b2a9918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:36.602683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 736/1477] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:36.900263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:36.903215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:37.108484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93040120-c9ba-4c57-a74d-1690c23da827 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:37.209333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:37.303941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:37.305015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:37.305489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:37.305962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:37.307188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:37.310754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:08:37.310754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:08:37.310754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:08:37.313202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe424cc-3d4e-4a48-b61d-8829d5bd773c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:37.351697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 742/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Mon Aug 29 20:08:36 2022] GET /identity/v3/projects => generated 2553 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:08:39.717819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.718669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.718669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.719850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 737/1479] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:08:39.728376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc22aa-14c8-43b6-a3bc-309f42ed37eb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:39.729026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc22aa-14c8-43b6-a3bc-309f42ed37eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:39.729202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc22aa-14c8-43b6-a3bc-309f42ed37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:39.816831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-39cc22aa-14c8-43b6-a3bc-309f42ed37eb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:39.818849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-39cc22aa-14c8-43b6-a3bc-309f42ed37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:39.993945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 743/1480] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:40.324187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:40.325818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:40.348160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.508397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817194d-3545-4020-8725-5f40c84ab049 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:40.598637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:40.643369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:40.644439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:40.644977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:40.645442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:40.648712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:40.812836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:40.814990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1923d-1f24-489c-b459-94dfe7a45c19 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:40.841782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 738/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:43.359949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.360585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.360984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.364529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 744/1482] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:43.373743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5572-5350-4ff8-bcd0-cd55ffb1fc46 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:43.374531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5572-5350-4ff8-bcd0-cd55ffb1fc46 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:43.374716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab5572-5350-4ff8-bcd0-cd55ffb1fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:43.487156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-78ab5572-5350-4ff8-bcd0-cd55ffb1fc46 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:43.489434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-78ab5572-5350-4ff8-bcd0-cd55ffb1fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:43.561894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:43.655581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 739/1483] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:44.059841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:44.061583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:44.089108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.208944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81037014-b98e-43bc-b03d-a8818b997670 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:44.318552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:44.319494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:44.319980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:44.320470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:44.323728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:44.565879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:44.608671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:44.610138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed247a-f032-434a-b809-256376b54cf8 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:44.633365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 745/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:08:46.961591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.962423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.962580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:46.965073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 740/1485] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:46.974528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b4967-d584-4239-b726-59aba8287070 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:46.975422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b4967-d584-4239-b726-59aba8287070 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:46.975422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b4967-d584-4239-b726-59aba8287070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.094842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-573b4967-d584-4239-b726-59aba8287070 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:47.097007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-573b4967-d584-4239-b726-59aba8287070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:47.262789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 746/1486] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:47.652335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:47.654020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:47.810660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279cd2e-fa6d-4e99-9831-9c7b5642cd83 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:47.916443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:47.918957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:47.919681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:47.920239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:47.920576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:47.922758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:48.082466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:48.084775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a8790-c7e6-4812-b7ef-52c79973bde9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:48.111185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 741/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:50.866095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.866724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.866851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.868213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 747/1488] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:50.877989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26224c8c-50c9-455d-b99f-9fb25d07b5ad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:50.878916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26224c8c-50c9-455d-b99f-9fb25d07b5ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:50.879478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26224c8c-50c9-455d-b99f-9fb25d07b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:50.977530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-26224c8c-50c9-455d-b99f-9fb25d07b5ad None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:50.979490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-26224c8c-50c9-455d-b99f-9fb25d07b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:51.054961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.122159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 742/1489] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:51.434940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:51.436519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:51.497745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.629000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88a01-3b3e-4f8e-a106-76b1a282eecc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:51.750456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:51.751224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:51.751619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:51.751981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:51.753968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:51.869760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:51.909796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:51.911791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120866-f417-4124-a364-c14900dd7106 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:51.935735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 748/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:08:54.880799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.881644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.881644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.883408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 743/1491] 10.222.0.61 () {54 vars in 927 bytes} [Mon Aug 29 20:08:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:08:54.889972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125d5e-cd70-43e4-b7a6-5ac3d1d2ffbe None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:54.890777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125d5e-cd70-43e4-b7a6-5ac3d1d2ffbe None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:54.890777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05125d5e-cd70-43e4-b7a6-5ac3d1d2ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:54.995743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-05125d5e-cd70-43e4-b7a6-5ac3d1d2ffbe None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:08:54.997104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-05125d5e-cd70-43e4-b7a6-5ac3d1d2ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:55.120721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 749/1492] 10.222.0.61 () {58 vars in 1024 bytes} [Mon Aug 29 20:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:08:55.479962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:08:55.484412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:55.645449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f0330-3e68-4d29-9f12-2142e4a56f11 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:08:55.765872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:08:55.767286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:08:55.767753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:08:55.768244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:08:55.771371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:08:55.791508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:08:55.970909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:08:55.973877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d05204-7ee6-4655-94ca-cd8480218f16 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:08:56.009937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 744/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:09:05.118681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=82 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:09:05.997033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=50 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:14.285182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.286125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.286125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.386977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:14.388213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:14.513508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 750/1494] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:10:14.522312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.522941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.523174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.547376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:14.548510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:14.558576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 745/1495] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:10:14.563893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.575202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd928a-0493-48c1-8406-08a5e382ca3d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.585861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.586660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.586986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.587373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.588254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:10:14.588662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.590304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.590304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:10:14.590304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:10:14.591604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.606442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 751/1496] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:10:14.616967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.628048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b05d-e9e6-4042-a238-5b48765f6cbe None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.634123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.634809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.635015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.635280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.635916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.637777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.637777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:10:14.637777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:10:14.638975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.697085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 746/1497] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:14.700164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.712177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fc6b2-0848-44bb-a16f-4bd5f708caa1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.767938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:14.777205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.777834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.778111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.778381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.779038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.780062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.780062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:10:14.780062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:10:14.781353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.808174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 752/1498] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:10:14.812688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.824510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588379-ef1b-450d-bde3-a4e330da767c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.829912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.830580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.830855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.831210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.832699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.833854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.833854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:10:14.833854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:10:14.834834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.851363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 747/1499] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:10:14.856152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.867847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e7419-cb38-4a5e-ac6e-33c3b53afd26 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.872892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.873512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.873784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.874073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.874698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.875746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.875746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:10:14.875746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:10:14.876634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7004e0-4110-49a2-831a-5ab6a82cc36d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.894731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 753/1500] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:10:14.899615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:14.911241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2876-2713-4085-a91b-6df6f5288384 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:14.916695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:14.917637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.917920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.918198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] PATH_INFO: `/v3/projects/2069706ea3474128b1279d1dfb371203/users/059cdffc87b44ac7ae268e7ac829db25/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:14.937748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2069706ea3474128b1279d1dfb371203, user_id=059cdffc87b44ac7ae268e7ac829db25, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:14.938879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:14.938879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:10:14.938879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:10:14.941053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e272f-29a9-4f70-9ab7-7888510d513b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:14.967719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 748/1501] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:10:14 2022] PUT /identity/v3/projects/2069706ea3474128b1279d1dfb371203/users/059cdffc87b44ac7ae268e7ac829db25/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:10:14.981162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c0df-19d9-4337-a933-7030e8273025 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:14.981460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c0df-19d9-4337-a933-7030e8273025 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:14.981744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6c0df-19d9-4337-a933-7030e8273025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.015088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c6d6c0df-19d9-4337-a933-7030e8273025 None None] MFA Rules not processed for user `059cdffc87b44ac7ae268e7ac829db25`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:15.016300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c6d6c0df-19d9-4337-a933-7030e8273025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:15.089786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 754/1502] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:10:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:10:15.104925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acedd0-d910-4fca-99a7-5b17dcf9f2a2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.105219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acedd0-d910-4fca-99a7-5b17dcf9f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.105526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acedd0-d910-4fca-99a7-5b17dcf9f2a2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.107041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 749/1503] 10.222.0.61 () {54 vars in 964 bytes} [Mon Aug 29 20:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:10:15.113381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bf2d5-6f54-43b0-af11-51d0f0f74c61 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.113771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bf2d5-6f54-43b0-af11-51d0f0f74c61 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.114080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bf2d5-6f54-43b0-af11-51d0f0f74c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.200296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7b2bf2d5-6f54-43b0-af11-51d0f0f74c61 None None] MFA Rules not processed for user `4fa74e5d2adb4da1afcecdb718be98f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:15.201711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7b2bf2d5-6f54-43b0-af11-51d0f0f74c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:15.297704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 755/1504] 10.222.0.61 () {58 vars in 1061 bytes} [Mon Aug 29 20:10:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:10:15.306293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acedd0-d910-4fca-99a7-5b17dcf9f2a2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.319327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acedd0-d910-4fca-99a7-5b17dcf9f2a2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.323490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.324124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.324405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.324679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.335286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.336873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.347263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 750/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:10:15.398227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5b20-c8a5-4ff5-b85d-46db72f2629b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.398513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5b20-c8a5-4ff5-b85d-46db72f2629b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.398790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a5b20-c8a5-4ff5-b85d-46db72f2629b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.400064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 756/1506] 10.222.0.61 () {52 vars in 830 bytes} [Mon Aug 29 20:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:10:15.404536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.502407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289aa5c-caba-49b2-be06-4174aeecb178 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.509596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.510501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.510876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.511230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] PATH_INFO: `/v3/users/059cdffc87b44ac7ae268e7ac829db25` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.512880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059cdffc87b44ac7ae268e7ac829db25)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.514310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:15.514310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:10:15.514310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:10:15.516122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.605433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059cdffc87b44ac7ae268e7ac829db25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:15.621519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059cdffc87b44ac7ae268e7ac829db25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:15.654273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059cdffc87b44ac7ae268e7ac829db25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:15.655126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059cdffc87b44ac7ae268e7ac829db25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:15.655929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059cdffc87b44ac7ae268e7ac829db25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:15.660896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:15.677728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 751/1507] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:10:15 2022] DELETE /identity/v3/users/059cdffc87b44ac7ae268e7ac829db25 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:10:15.682384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9194-662f-461e-9724-38235cdf8475 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.682709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9194-662f-461e-9724-38235cdf8475 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.682971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9194-662f-461e-9724-38235cdf8475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.703412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-985f9194-662f-461e-9724-38235cdf8475 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:10:15.704641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-985f9194-662f-461e-9724-38235cdf8475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:15.714910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:15.772899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 757/1508] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:10:15.782867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:15.784511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:15.904565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f32f9b-2dbb-414c-acea-4da21fa300d8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:15.911120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:15.912159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:15.912642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:15.913170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:15.930412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:15.933229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cc990-cb80-4dea-8b09-8016f3ad2734 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:15.949604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 752/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:10:16.361373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9194-662f-461e-9724-38235cdf8475 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:10:16.363431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-985f9194-662f-461e-9724-38235cdf8475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:10:16.382795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9194-662f-461e-9724-38235cdf8475 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:10:16.389999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:10:16.391787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:10:16.391787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:10:16.391787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] PATH_INFO: `/v3/projects/2069706ea3474128b1279d1dfb371203` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:10:16.393397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2069706ea3474128b1279d1dfb371203)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:10:16.395446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:10:16.395446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:10:16.395446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:10:16.397514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:10:16.476657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2069706ea3474128b1279d1dfb371203', 'request_id': 'req-242d4021-ade7-4bf9-81b9-430d3d621360'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:16.492187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2069706ea3474128b1279d1dfb371203', 'request_id': 'req-242d4021-ade7-4bf9-81b9-430d3d621360'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:16.500618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2069706ea3474128b1279d1dfb371203', 'request_id': 'req-242d4021-ade7-4bf9-81b9-430d3d621360'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:16.519242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] The token cache is being invalidate because project 2069706ea3474128b1279d1dfb371203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:10:16.519601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:16.520324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-242d4021-ade7-4bf9-81b9-430d3d621360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:10:16.521969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 758/1510] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:10:16 2022] DELETE /identity/v3/projects/2069706ea3474128b1279d1dfb371203 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:10:25.943322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:10:26.515490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:11:59.004704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.005535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.005535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.007315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:11:59.012965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd973-109c-463b-a67f-42d9a3e9e420 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.013672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd973-109c-463b-a67f-42d9a3e9e420 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.013672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd973-109c-463b-a67f-42d9a3e9e420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.044414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a15cd973-109c-463b-a67f-42d9a3e9e420 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:11:59.045707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a15cd973-109c-463b-a67f-42d9a3e9e420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:59.112434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:11:59.285329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:11:59.288100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:11:59.436739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d0ec-f7b0-4eec-8719-1ab050909770 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:11:59.450676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e950-667a-4078-b004-b99bc871611d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:11:59.451336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e950-667a-4078-b004-b99bc871611d service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:11:59.451681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e950-667a-4078-b004-b99bc871611d service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:11:59.451927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e950-667a-4078-b004-b99bc871611d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:11:59.465566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e950-667a-4078-b004-b99bc871611d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:11:59.468506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e950-667a-4078-b004-b99bc871611d service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:11:59.486410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 754/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:00.489305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5093-7310-4859-97c1-d7c7b50eb5ff None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.489979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5093-7310-4859-97c1-d7c7b50eb5ff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.489979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b5093-7310-4859-97c1-d7c7b50eb5ff None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.491374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:00.497204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5796-41e3-41df-bf75-1d56b4574c1d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.497928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5796-41e3-41df-bf75-1d56b4574c1d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.497928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5796-41e3-41df-bf75-1d56b4574c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.526385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-989f5796-41e3-41df-bf75-1d56b4574c1d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:00.527674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-989f5796-41e3-41df-bf75-1d56b4574c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:00.537275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:00.713348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b5093-7310-4859-97c1-d7c7b50eb5ff None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:00.732219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b5093-7310-4859-97c1-d7c7b50eb5ff None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:00.739643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:00.740359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.740635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.740971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.752017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:00.753782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8700f5-4c9f-42df-bf98-54004828edaf service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:00.766497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 761/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:00.790860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45566c-55a1-432d-ae1d-920c45ad8d49 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.791217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45566c-55a1-432d-ae1d-920c45ad8d49 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.791669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45566c-55a1-432d-ae1d-920c45ad8d49 None None] PATH_INFO: `/v3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.793687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 756/1517] 10.222.0.83 () {54 vars in 925 bytes} [Mon Aug 29 20:12:00 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:12:00.803105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7906-5107-4ab0-9852-631003f826d2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:00.804133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7906-5107-4ab0-9852-631003f826d2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:00.804133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7906-5107-4ab0-9852-631003f826d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:00.906238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-045f7906-5107-4ab0-9852-631003f826d2 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:00.907902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-045f7906-5107-4ab0-9852-631003f826d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:01.008228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 762/1518] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 20:12:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:10.048844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a776-0e2f-42d9-a503-e49e3d3dbbd5 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.049619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a776-0e2f-42d9-a503-e49e3d3dbbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.049619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22a776-0e2f-42d9-a503-e49e3d3dbbd5 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.052158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 757/1519] 10.222.0.61 () {54 vars in 961 bytes} [Mon Aug 29 20:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:10.057093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c2795-1477-4e67-85a1-78c3a2946501 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.057675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c2795-1477-4e67-85a1-78c3a2946501 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.057675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c2795-1477-4e67-85a1-78c3a2946501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.078716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2f6c2795-1477-4e67-85a1-78c3a2946501 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:10.079924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2f6c2795-1477-4e67-85a1-78c3a2946501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:10.090463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 763/1520] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Aug 29 20:12:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:10.099353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a776-0e2f-42d9-a503-e49e3d3dbbd5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:10.116114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22a776-0e2f-42d9-a503-e49e3d3dbbd5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:10.121562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:10.122176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:10.122451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:10.122722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:10.132121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:10.133783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7136f2c-1ef2-4e16-857a-4a9ca34f8066 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:10.147290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 758/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:12.035925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252b6a-5c31-48de-ab34-a8fe7d94e0fc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:12.036538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252b6a-5c31-48de-ab34-a8fe7d94e0fc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:12.036656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252b6a-5c31-48de-ab34-a8fe7d94e0fc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:12.038855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:12:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:12.044966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a8bc-9176-4426-bd2c-876dc988431e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:12.045492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a8bc-9176-4426-bd2c-876dc988431e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:12.045690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a8bc-9176-4426-bd2c-876dc988431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:12.067533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cc97a8bc-9176-4426-bd2c-876dc988431e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:12.068769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cc97a8bc-9176-4426-bd2c-876dc988431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:12.076770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:12.237122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252b6a-5c31-48de-ab34-a8fe7d94e0fc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:12.253835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252b6a-5c31-48de-ab34-a8fe7d94e0fc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:12.259769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:12.260385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:12.260657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:12.260954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:12.271871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:12.273580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705b693-db10-4c7d-80fb-d1edb658170a service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:12.285747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 765/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:13.176569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702a43-5df1-4aff-af5a-9f02b1f199d2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.177197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702a43-5df1-4aff-af5a-9f02b1f199d2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.177197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3702a43-5df1-4aff-af5a-9f02b1f199d2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.178493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 20:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:13.185828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936262-abcf-4af3-8ffb-3709b51a5437 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.186436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936262-abcf-4af3-8ffb-3709b51a5437 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.186436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd936262-abcf-4af3-8ffb-3709b51a5437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.212091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bd936262-abcf-4af3-8ffb-3709b51a5437 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:13.213371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bd936262-abcf-4af3-8ffb-3709b51a5437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:13.222171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 20:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:13.404167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3702a43-5df1-4aff-af5a-9f02b1f199d2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:13.424711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3702a43-5df1-4aff-af5a-9f02b1f199d2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:13.432309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:13.433222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:13.433638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:13.434045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:13.447438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:13.450085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb816-eec6-41ee-ac13-f72ecdc90c0b service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:13.461805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 761/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:17.820619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:17.821207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:17.821551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:17.823497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:17.829624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf205a-945c-4a60-9cda-fd5abcb691f8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:17.830272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf205a-945c-4a60-9cda-fd5abcb691f8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:17.830692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf205a-945c-4a60-9cda-fd5abcb691f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:17.854423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6abf205a-945c-4a60-9cda-fd5abcb691f8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:17.855680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6abf205a-945c-4a60-9cda-fd5abcb691f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:17.868171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:18.187493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:18.189638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:18.224071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:18.260735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2474b1f-671b-4e52-9eac-4d0e922f0fc2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:18.264302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:18.265030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:18.265306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:18.265571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:18.276056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:18.277627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807f445-2bd5-412d-b8ff-e771f66b26d1 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:18.290296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 768/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:20.382036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524632f-6136-4a84-a634-f14734c926f6 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:20.382913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524632f-6136-4a84-a634-f14734c926f6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:20.382913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524632f-6136-4a84-a634-f14734c926f6 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:20.383843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:20.389881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cc3b-4514-4ebf-9505-752626603b2b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:20.390494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cc3b-4514-4ebf-9505-752626603b2b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:20.390711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541cc3b-4514-4ebf-9505-752626603b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:20.414593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4541cc3b-4514-4ebf-9505-752626603b2b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:20.415816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4541cc3b-4514-4ebf-9505-752626603b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:20.425228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:20.726385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524632f-6136-4a84-a634-f14734c926f6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:20.741615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524632f-6136-4a84-a634-f14734c926f6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:20.745516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:20.746255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:20.746590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:20.746979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:20.758807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:20.760285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3a70-0e36-48e5-b5a0-8176799032ee service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:20.773997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 764/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:24.637361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:24.638123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:24.638123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:24.639217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:24.645938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322aa9-c4f6-4c92-a51d-e91a3311832d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:24.646541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322aa9-c4f6-4c92-a51d-e91a3311832d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:24.646541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1322aa9-c4f6-4c92-a51d-e91a3311832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:24.818661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e1322aa9-c4f6-4c92-a51d-e91a3311832d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:24.820836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e1322aa9-c4f6-4c92-a51d-e91a3311832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:24.839682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:25.518786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:25.520802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:25.583378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f0001-6df5-48ec-8efa-f8716b7b9afb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:25.587373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:25.588028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:25.588391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:25.588703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:25.598267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:25.599710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2998a-2575-4829-9fd6-f0d0ac2ca51b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:25.609559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 771/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:12:27.972647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:27.973289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:27.973289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:27.974586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:12:27.980328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0544-bdbe-4a76-bb93-1edaf8c34d02 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:27.980962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0544-bdbe-4a76-bb93-1edaf8c34d02 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:27.980962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced0544-bdbe-4a76-bb93-1edaf8c34d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:28.003151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bced0544-bdbe-4a76-bb93-1edaf8c34d02 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:12:28.004657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bced0544-bdbe-4a76-bb93-1edaf8c34d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:28.013445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:12:28.575304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:12:28.577615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:12:28.589073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=77 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:28.597732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957a66f-e7f7-4f2e-84cc-9e22b357638a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:12:28.601496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:12:28.602141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:12:28.602478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:12:28.602779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:12:28.614571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:12:28.616107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4e537-e2a5-4fed-8d4b-fba9ef6890a6 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:12:28.626486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 767/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:12:37.996850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=47 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:12:38.622084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:01.377971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.379454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.379934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.420887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:01.424712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:01.438401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 773/1540] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:01.456080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.456892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.456892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.487430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:01.489049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:01.511132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 768/1541] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:01.519019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:01.539596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b66b5-fe5a-47e7-bc49-7e5c02d543a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:01.544953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:01.546243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.547019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.547543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.548467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:01.549023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:01.551212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef1fbf-e825-45c3-8ae5-02a7c0ad6a6b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:01.571695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 774/1542] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:01.583779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:01.598823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ff8c2-dd17-4898-94ea-ee9363191a5a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:01.607645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:01.608284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.608561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.608851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.609856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:01.612146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:01.677639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 769/1543] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:01.680368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.681028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.681531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.695110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:01.719026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:01.721458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:01.802029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c871b9-bc66-4ba4-8f81-886309edae09 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:01.807227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:01.807863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.808142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.808418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.813762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:01.815213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:01.815213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:14:01.815213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:14:01.816624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58440bce-3085-450d-90d5-2dc9fbc35598 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:01.868847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 770/1544] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:14:01.868847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa0f90-92b2-43cf-aca3-4dec4c2e1e8e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.868847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa0f90-92b2-43cf-aca3-4dec4c2e1e8e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.868847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa0f90-92b2-43cf-aca3-4dec4c2e1e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.921746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-68fa0f90-92b2-43cf-aca3-4dec4c2e1e8e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:01.923774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-68fa0f90-92b2-43cf-aca3-4dec4c2e1e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:01.946869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 771/1545] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:01.948677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b743-cbbc-41fe-a71d-67ef099aa70a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:01.954335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b743-cbbc-41fe-a71d-67ef099aa70a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:01.954915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25b743-cbbc-41fe-a71d-67ef099aa70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:01.959447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 775/1546] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:01.960979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:01.993817 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68642e52-fefd-48f2-9f38-76ac4b073fe6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:01.998963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0b25b743-cbbc-41fe-a71d-67ef099aa70a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.000515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b25b743-cbbc-41fe-a71d-67ef099aa70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.017782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.018571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.018852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.019147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.019811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.021616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced2d7b-d3a6-4ea4-811d-c34dbe4b9c22 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.026141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 772/1547] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.029025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9543-3f7f-4aa0-b72a-5e19d0167349 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.029465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9543-3f7f-4aa0-b72a-5e19d0167349 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.029833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9543-3f7f-4aa0-b72a-5e19d0167349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.049070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 776/1548] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:02.051433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.052115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.052317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.082087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d5bd9543-3f7f-4aa0-b72a-5e19d0167349 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.083878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d5bd9543-3f7f-4aa0-b72a-5e19d0167349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.111518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 773/1549] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.113082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.113294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.113596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.113858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.114324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.144162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 777/1550] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.145266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.150925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.152143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.172671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09dce-1d21-4aba-a183-89b5b3dfcecf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.176261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 774/1551] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.178182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.183202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.183933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.184247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.184574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.185206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.186852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.198890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 778/1552] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:02.199478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.204849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eecd1-1901-40f2-a298-00c2a320e0ec None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.213801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186e16-0486-44e9-919e-446d1512b3ba admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.224528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.226091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.228310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.229279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.232513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:02.233426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.237408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:02.237408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:14:02.237408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:14:02.238431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cab95-4763-4a03-9308-82b70085ffc5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.241168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.242615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.242895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.243236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.243869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:02.244158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.245897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202c24-455f-4915-a62a-a8b7051efa1d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.271370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 775/1553] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:02.272230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 779/1554] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:02.272968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.273529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.273913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.282746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.282746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.282746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.305277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.305746 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.306470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.307806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.316480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 780/1555] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.318582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.321028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 776/1556] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.321952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.333336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59671-c36d-443b-8a65-27f45ed73e11 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.339101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.339811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.340102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.340374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] PATH_INFO: `/v3/projects/614b383c34ac435eb768f745481a771b/users/99280ba1a6bc4bc89e18103962d5e710/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.340502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba44b-6dae-4bae-96cb-3174f8d4dc51 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.346540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.347183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.347468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.347713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.348370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:02.349255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.351125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2cc58-5122-4eb8-8d63-a4ae4965f827 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.367943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=614b383c34ac435eb768f745481a771b, user_id=99280ba1a6bc4bc89e18103962d5e710, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.371277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212036d-b9ba-47dc-a6ad-fea5f727ce4f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.376860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 781/1557] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:02.376860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.376860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.376860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.397384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 777/1558] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:02 2022] PUT /identity/v3/projects/614b383c34ac435eb768f745481a771b/users/99280ba1a6bc4bc89e18103962d5e710/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:02.399213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.399669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.400103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.403038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.405061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.425114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.426500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.478381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:02.491373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 782/1559] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.492890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.507784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 778/1560] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.509311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.512536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14514fa-8f2a-4787-b03f-f8b01d279029 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.520830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.521467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.521755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.522007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.522656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.523665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:02.523665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:14:02.523665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:14:02.524125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fc902-58a1-47fe-b488-42e705eb6dc7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.524891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077035-e162-4545-9034-e80c7f74cd29 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.529667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.530509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.530889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.531356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.532077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.534207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de4d44-238f-4653-88df-1a2a64cb26a2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.549137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:02.558729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 783/1561] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:02.560110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.560823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.560982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.569175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 779/1562] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:02.573398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13996c-bb9a-4681-b8c3-69abf4753610 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.573679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13996c-bb9a-4681-b8c3-69abf4753610 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.573948 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13996c-bb9a-4681-b8c3-69abf4753610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.590185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.591713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.595676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6e13996c-bb9a-4681-b8c3-69abf4753610 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.596912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6e13996c-bb9a-4681-b8c3-69abf4753610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.681302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 784/1563] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.682215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.692714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 780/1564] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.695295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abab0d5-41b6-4125-9c6e-9501075f94cf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.696407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba8f34-7fe5-4aeb-bdea-a9ee40c3b104 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.696407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba8f34-7fe5-4aeb-bdea-a9ee40c3b104 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.696407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba8f34-7fe5-4aeb-bdea-a9ee40c3b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.704180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.704859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.705338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.705601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.706255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.708248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a80c6-6868-4ec7-bcb7-62e3c7288edf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.736737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8cba8f34-7fe5-4aeb-bdea-a9ee40c3b104 None None] MFA Rules not processed for user `99280ba1a6bc4bc89e18103962d5e710`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.737895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8cba8f34-7fe5-4aeb-bdea-a9ee40c3b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.747391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 785/1565] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:02.747391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.747391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.747391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.771845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.773162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.842706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 781/1566] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.844921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.845677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.846019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.873139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:02.875325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 786/1567] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.875549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:02.877294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.889080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 782/1568] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:02.890744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.897779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303131c-5d4f-4851-a432-36e4a56dc18c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.906277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71feafe-7f44-44b2-96fe-aa95a6594aa2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.911748 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.912395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.912679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.913839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.913839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.915046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.915577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.915778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.916030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.916379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.917273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.919114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.943155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 787/1569] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:02.947222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 783/1570] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:02.947406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.947519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.961461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332744-409b-4095-819d-4ebb4c0f6b11 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.961734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ea28b-954f-4eac-a8fd-124e208d8912 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:02.966260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.966876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.967147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.967419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.967578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:02.968040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:02.968342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.968473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:02.968784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:02.969127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:02.969847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:02.970143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.970256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:02.971960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:02.983508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 788/1571] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:02.985538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:02.990878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 784/1572] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:02.992891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.004987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01407a4-0636-456c-ba58-d8f42a124c3c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.009499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1374ff-3896-4b6d-9e2d-7db1cb8de9b4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.009818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.010429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.010719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.010984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.011608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.013587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.015430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.016111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.016385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.016741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.017426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:03.017720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.019335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aa758-f993-4902-bad5-d8357573b718 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.033870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 785/1573] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:03.044093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33aa35-a020-4c10-a06f-09283be91c1e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.044093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33aa35-a020-4c10-a06f-09283be91c1e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.044093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33aa35-a020-4c10-a06f-09283be91c1e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.044093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 786/1574] 10.222.0.61 () {54 vars in 962 bytes} [Mon Aug 29 20:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:03.044093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33aa35-a020-4c10-a06f-09283be91c1e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.044497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 789/1575] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:02 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.044497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.054296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f02a-4c92-402d-8f8b-75643a0cc87d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.058897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33aa35-a020-4c10-a06f-09283be91c1e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.059487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.060105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.060380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.060638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.061315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.063036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.066190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.067049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.067380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.067652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.068337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:03.068850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.071499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.075679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.077279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 790/1576] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.078470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.089786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d31f14-37a3-4aa7-a44d-3b327abed6bc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.090785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 787/1577] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:03.092038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.101413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.102540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.102993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.103425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.104312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74ce0a-f888-4f13-9b69-89241114c7e5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.104488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.109725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.110161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.110634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.110915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.111182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.111823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.113799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.130702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 791/1578] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.130702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.141132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce756fd-e13f-4130-ac72-b14cc7e6c371 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.146178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.146828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.147101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.147369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.148005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.149955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.154957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 788/1579] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.154957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.155257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.189130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 792/1580] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.190311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.230721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2db2d7-496f-44ea-86b7-9fc67bec81f7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.267583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef2779-8494-4428-81f5-cb8873fe7812 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.274605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.275567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.276008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.276695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.277821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.280780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c404-21a3-4395-9b96-f2a72378fd04 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.319646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.320450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.320946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.321321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.322186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.324040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.324488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 793/1581] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.326807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.327276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.327751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.337685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 789/1582] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.339105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.352045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ccfb7-da41-462e-8d7d-0536e7fe5aa4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.377832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:03.379282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:03.430872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.431708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.432173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.432674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.433823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.436424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.451693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 790/1583] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.452311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.464241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163a08-927f-48ec-ba3b-69eb206fb5eb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.471814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.472809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.473258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.473717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.474824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.477012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.489118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 794/1584] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:03.490784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.494807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.509514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35abd-498e-49ef-9da2-73cecf77af9f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.518301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.519204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.520591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.521239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.522229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.525749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.527779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 791/1585] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.529296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.552235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 795/1586] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.552235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.569783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a93b-c952-48bb-a663-5089bfe27ca3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.628033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.635202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404689-c0c8-4d77-9d43-d82f76eb55d1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.642322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.643291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.643678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.644068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.645943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.648177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.675091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.676153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.676342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.676741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.677717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.679777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.682348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 792/1587] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.683699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.703170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d230-0e9e-42a8-b93d-1647461f6505 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.710922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 796/1588] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.711597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.712271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.712673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.713225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.713747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.715237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.718895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.725270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0aa99-21f1-4a3d-8186-c316587105ff admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.730653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.731422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.731754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.732172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.733267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.736411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.758260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 797/1589] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:03.758260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.758747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 793/1590] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/users => generated 297 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.758747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.771043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8a94a-c239-417b-ad44-12cb64d29890 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.776288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.777086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.777421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.777688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] PATH_INFO: `/v3/projects/713dc968d193462ab7c611a89022107e/users/987a3768b7d449e3a732899b8358ac28/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.796574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713dc968d193462ab7c611a89022107e, user_id=987a3768b7d449e3a732899b8358ac28, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.798566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:03.798566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:14:03.798566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:14:03.802729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.824258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 798/1591] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:03 2022] PUT /identity/v3/projects/713dc968d193462ab7c611a89022107e/users/987a3768b7d449e3a732899b8358ac28/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:03.825940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.872639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108defca-fa1f-46f1-b4ba-bf42862ab893 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.921087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c67e8-b347-474a-8bb9-a368965fe8d1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.927744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.928376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.928649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.928941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.929662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:03.932281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:03.959530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 799/1592] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:03 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:03.961131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:03.972692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb17ef-6c83-4c01-b2d1-54e95ab9b9f9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:03.973662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:03.978518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.979201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.979477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.979804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] PATH_INFO: `/v3/projects/7b3b1b1e93f242dd9824c206ee3efc57/users/2f6fbce6c07145b1815510bf9b8f2049/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:03.989726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:03.990400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:03.990720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:03.990997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.001029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3b1b1e93f242dd9824c206ee3efc57, user_id=2f6fbce6c07145b1815510bf9b8f2049, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.004538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.023226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 800/1593] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:03 2022] PUT /identity/v3/projects/7b3b1b1e93f242dd9824c206ee3efc57/users/2f6fbce6c07145b1815510bf9b8f2049/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:04.023671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.093035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.095549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.105912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 794/1594] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:04.106673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.123396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ca26-532d-4958-a353-c12f1e26b0bb service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.123743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:04.128399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8a20e-0c67-4d1a-bd28-7c8053308dfa admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.135069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.136337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.136870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.137199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.137851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.139944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.140157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.142340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.142340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.143516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.145024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.148270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.157284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 795/1595] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.159081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.170714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b5b0b-0883-4fb1-98d5-2b0b552cc360 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.172329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 801/1596] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.173559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.182094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.183304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.183905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.184513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] PATH_INFO: `/v3/projects/9acea5edc9c849c38cb58cda3b8ff592/users/a48be8d8f3df4819bcaf18ddda2ef359/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.191911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc8f60-0cfa-4d46-a882-22c35b0aef38 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.197057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.197672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.197948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.198216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.198859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.201853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db799f-491d-403e-acd2-809893798572 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.213085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9acea5edc9c849c38cb58cda3b8ff592, user_id=a48be8d8f3df4819bcaf18ddda2ef359, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.216542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 802/1597] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.218642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.219003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.219501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.222198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.246699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 796/1598] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:04 2022] PUT /identity/v3/projects/9acea5edc9c849c38cb58cda3b8ff592/users/a48be8d8f3df4819bcaf18ddda2ef359/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:04.248978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.267847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] MFA Rules not processed for user `987a3768b7d449e3a732899b8358ac28`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:04.267847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:04.350070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9ff5a-c13c-4d2a-8b86-2a6d488afc3c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.357496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.358397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.358876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.359719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.360884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.364052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d4e65-bd76-4f7f-ad1f-c86325b545b3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.382217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 797/1599] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.386449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.386714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.386982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.396621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 803/1600] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:04.396621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.417242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:04.418508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a533f-bf44-4a6b-8848-d4b0013d972b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.418696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:04.427017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.427705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 798/1601] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:04.428302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.428537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.429039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.429584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.430862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.434444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.442461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130068e-046a-4533-b9b0-86aa8338fb85 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.449586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.450410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.450681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.450967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.451666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.453422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9027e2b-096c-47ea-8b44-c17a84b7acfa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.455614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 804/1602] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.456974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.466120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 799/1603] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.467410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.467994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.468628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.471049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322e7b-13e2-4c16-8bef-db37bade68be admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.478582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.479608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.480085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.480548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.481735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.485193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4572d0-98f0-419e-8f95-cb422755d187 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.491768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:04.493056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:04.502916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 800/1604] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:04.503915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.509684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 805/1605] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.509684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2c65-a683-4dba-8419-1fc3e7307be6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.509684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2c65-a683-4dba-8419-1fc3e7307be6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.510962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c2c65-a683-4dba-8419-1fc3e7307be6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.513083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 806/1606] 10.222.0.61 () {54 vars in 912 bytes} [Mon Aug 29 20:14:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:04.513807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f9b58-b623-4d91-a121-7f2dafecb02f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.514280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c2c65-a683-4dba-8419-1fc3e7307be6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.519757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.520497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.520792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.521054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.521700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.523299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.542647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 801/1607] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:04.542647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.586451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:04.587697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c2c65-a683-4dba-8419-1fc3e7307be6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.594751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.595832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.596197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.596628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.610480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.614021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.626928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 807/1608] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:04.627785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.637172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ecd88-3d7d-4a95-978c-b6c68119c310 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.641917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e88b7-0deb-4688-b3ba-ba3502a58d6a service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.644617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.645657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.646377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.646834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.649133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.650279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.650689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.650913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] PATH_INFO: `/v3/projects/94f8d1031de242a2895acd6f7efa54a4/users/5fc6c6bcb9fe470584f3a538c727268e/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.665070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.667790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.672419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f8d1031de242a2895acd6f7efa54a4, user_id=5fc6c6bcb9fe470584f3a538c727268e, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.676066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.689482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 802/1609] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:04.690885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.701857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 808/1610] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:04 2022] PUT /identity/v3/projects/94f8d1031de242a2895acd6f7efa54a4/users/5fc6c6bcb9fe470584f3a538c727268e/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:04.702780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.719023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc0a1-e50b-43a4-a247-cc49899da308 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.751760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:04.820239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7c91d-834e-482d-b1bb-71352cd24534 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:04.829485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.831046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.831765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.832548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] PATH_INFO: `/v3/projects/f6cdc9e973c2453ca579483b372ddb7a/users/cc68601c71074f1b86b9698193289f92/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.871317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cdc9e973c2453ca579483b372ddb7a, user_id=cc68601c71074f1b86b9698193289f92, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.877355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ae390-f113-46a9-8b6f-32aef0749fc2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.879053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:04.880104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.880598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.882133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] PATH_INFO: `/v3/projects/c4412f6861be4d24b7686d5346ff6227/users/c45a888899614d0fb2e91c254209383d/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.907674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4412f6861be4d24b7686d5346ff6227, user_id=c45a888899614d0fb2e91c254209383d, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:04.911029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:04.913688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 809/1611] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:04 2022] PUT /identity/v3/projects/f6cdc9e973c2453ca579483b372ddb7a/users/cc68601c71074f1b86b9698193289f92/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:04.919021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:04.919319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:04.920036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:04.952057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 803/1612] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:04 2022] PUT /identity/v3/projects/c4412f6861be4d24b7686d5346ff6227/users/c45a888899614d0fb2e91c254209383d/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:04.952057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:04.958052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:04.959675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.096174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4cca-abd0-4d44-bae1-fc4adf69a8e9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:05.101328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:05.101652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.101924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.102230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.117085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 810/1613] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:05.118462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:05.261480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82615-d8f6-4104-9669-70bf5ce592b1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:05.281397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:05.283667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd89026-5dd7-4c04-8ec2-edb16cbe7c4c service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:05.287660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:05.291727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.295076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.295387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] PATH_INFO: `/v3/projects/de9965393a52440fa24f4577683a567d/users/e3cc61673b284d8dae02a659a6635adc/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.303151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:05.323103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 804/1614] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:05.328346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676e75-caa8-42d0-8e44-6ddb99bb12ec None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.328611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676e75-caa8-42d0-8e44-6ddb99bb12ec None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.329114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676e75-caa8-42d0-8e44-6ddb99bb12ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.358043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9965393a52440fa24f4577683a567d, user_id=e3cc61673b284d8dae02a659a6635adc, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:05.381705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9b676e75-caa8-42d0-8e44-6ddb99bb12ec None None] MFA Rules not processed for user `5fc6c6bcb9fe470584f3a538c727268e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:05.382721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ad86-bfe8-4aba-b8a2-be6c42ae0fd4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:05.383479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9b676e75-caa8-42d0-8e44-6ddb99bb12ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.429948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 811/1615] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:05 2022] PUT /identity/v3/projects/de9965393a52440fa24f4577683a567d/users/e3cc61673b284d8dae02a659a6635adc/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:05.429948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.429948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.429948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.485348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:05.494270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.521343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 805/1616] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:05.528904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844fa6-9959-4cb7-acaf-b9be8b7757b2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.528904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844fa6-9959-4cb7-acaf-b9be8b7757b2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.528904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b844fa6-9959-4cb7-acaf-b9be8b7757b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.604520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:05.643190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2b844fa6-9959-4cb7-acaf-b9be8b7757b2 None None] MFA Rules not processed for user `c45a888899614d0fb2e91c254209383d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:05.644519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b844fa6-9959-4cb7-acaf-b9be8b7757b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.780240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 812/1617] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:05.781910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:05.890125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 806/1618] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:05.897401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576cc4-59dc-4e2d-a7fd-e1c42a1eeedc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.899143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576cc4-59dc-4e2d-a7fd-e1c42a1eeedc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.899615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4576cc4-59dc-4e2d-a7fd-e1c42a1eeedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.946011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6423f5-14e6-41b5-8075-6524d357ddb8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:05.960180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:05.961667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.962681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.962991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.968929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d4576cc4-59dc-4e2d-a7fd-e1c42a1eeedc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:05.974054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d4576cc4-59dc-4e2d-a7fd-e1c42a1eeedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:05.989946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 807/1619] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:05.991698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:05.992031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:05.992338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:05.993983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 808/1620] 10.222.0.61 () {54 vars in 962 bytes} [Mon Aug 29 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:06.000948 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.003164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:06.211277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729435b-f8fd-414b-bccc-fdadf5bb27b1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.216255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.217084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.217632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.218139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.225601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.229458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.244636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.247882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7adeb-e54e-4f1b-a199-5ce97dced122 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.264642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 813/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:06.267308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.278937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 809/1622] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:06.279875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.280369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.287965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.305263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478255e-34b5-43c0-be13-e4a273913fab service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.318691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.320226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.320713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.321344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.322795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.326887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.343252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:06.350759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:06.363045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 810/1623] 10.222.0.61 () {58 vars in 1059 bytes} [Mon Aug 29 20:14:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:06.363920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.375858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456eec5-7eb9-4a9c-9496-6a5e92910ff8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.389647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.392356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.393139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.393441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.418720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:06.427355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.430265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.443109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 814/1624] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:06 2022] POST /identity/v3/projects => generated 405 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:06.444349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.467595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 811/1625] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:06.472324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.516865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1902456-cb48-4619-9e61-78512dfdb279 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.536877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:06.587758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e1e1-5246-4729-81ee-09909638239c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.600463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.605158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.605158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.605158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.719793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.723285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.723851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.724286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.725474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.739532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.798518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.806414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.812804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 812/1626] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:06 2022] POST /identity/v3/users => generated 309 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:06.815235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.854755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d214e-6836-4a46-9277-22f00ba9c238 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.856447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 815/1627] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:06.877671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.880524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.883143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.884043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:06.886978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:06.890946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:06.926223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 813/1628] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:06.931727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:06.964718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029041-2cba-4c62-92c2-ff7a128149d1 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:06.987743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:06.990193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:06.994531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:06.996495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] PATH_INFO: `/v3/projects/c0d18e10f5b9422097e101d3c921f96e/users/d6c1e1eb8db048b0b61d00fbd52ab61c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.034102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d18e10f5b9422097e101d3c921f96e, user_id=d6c1e1eb8db048b0b61d00fbd52ab61c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:07.041145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:07.066224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 816/1629] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:06 2022] PUT /identity/v3/projects/c0d18e10f5b9422097e101d3c921f96e/users/d6c1e1eb8db048b0b61d00fbd52ab61c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:07.071293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:07.090544 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff787d-cff8-48f1-b3bd-446b05bfc737 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:07.239378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:07.240574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.241823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.242435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.243849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:07.246923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92ecdd-3ac7-481a-a4e1-8e5b204467c7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:07.270776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 814/1630] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:07.275832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:07.291085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5c9f-ff13-45bf-a970-3bd47953889c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:07.296118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:07.298590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.298905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.299171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] PATH_INFO: `/v3/projects/c0d18e10f5b9422097e101d3c921f96e/users/d6c1e1eb8db048b0b61d00fbd52ab61c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.301589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d18e10f5b9422097e101d3c921f96e, user_id=d6c1e1eb8db048b0b61d00fbd52ab61c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:07.305383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:07.340567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5aa1-95f4-4945-b378-76c8dc922ff4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.341826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5aa1-95f4-4945-b378-76c8dc922ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.342307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5aa1-95f4-4945-b378-76c8dc922ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.349634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 817/1631] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:07 2022] PUT /identity/v3/projects/c0d18e10f5b9422097e101d3c921f96e/users/d6c1e1eb8db048b0b61d00fbd52ab61c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:07.419208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d52b5aa1-95f4-4945-b378-76c8dc922ff4 None None] MFA Rules not processed for user `d6c1e1eb8db048b0b61d00fbd52ab61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:07.420668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d52b5aa1-95f4-4945-b378-76c8dc922ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:07.610511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:07.633599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 815/1632] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:07.647564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:07.744298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a49d-4f44-48ef-ae60-80b13282001c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.746052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a49d-4f44-48ef-ae60-80b13282001c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.746514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a49d-4f44-48ef-ae60-80b13282001c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.751374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 816/1633] 10.222.0.61 () {54 vars in 912 bytes} [Mon Aug 29 20:14:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:07.778073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.778624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.779104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.857974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386e1bc-7d72-4440-b099-cd15c779c37e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:07.860826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:07.866309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:07.876599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:07.883538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:07.884294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:07.884780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:07.931777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:07.938872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:07.999350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 818/1634] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:08.151261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 817/1635] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:08.292964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:08.315404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce414b9-7b8b-47e4-b1de-674061745b5e service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:08.326589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:08.327957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:08.329582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:08.330300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:08.364216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:08.368467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833d2fb-eb58-4a61-8f79-4ea2a601e7f5 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:08.448880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 819/1636] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:09.561809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:09.893685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605b1f-8bf0-4553-803d-102fd0f59cc4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:09.909584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:09.914459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:09.915112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:09.916193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] PATH_INFO: `/v3/users/c45a888899614d0fb2e91c254209383d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:09.920817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45a888899614d0fb2e91c254209383d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:09.926698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:10.065056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45a888899614d0fb2e91c254209383d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:10.074619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45a888899614d0fb2e91c254209383d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:10.102219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45a888899614d0fb2e91c254209383d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:10.103051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45a888899614d0fb2e91c254209383d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:10.103786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45a888899614d0fb2e91c254209383d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:10.138115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 818/1637] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:09 2022] DELETE /identity/v3/users/c45a888899614d0fb2e91c254209383d => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:10.143185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:10.143747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:10.143747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:10.190360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:10.194843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:10.301027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.404182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 820/1638] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:10.446304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:10.447895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:10.469641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:10.712269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e12695-7195-497b-a9ab-0949399a5286 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:10.729844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:10.737451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:10.739204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:10.740280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:10.796060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:10.814548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:10.873776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 819/1639] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:12.473490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:12.474998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:12.525255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a39a9-4d71-4baa-84b0-d775f85fd08f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:12.548223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:12.550876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:12.551633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:12.552605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] PATH_INFO: `/v3/projects/c4412f6861be4d24b7686d5346ff6227` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:12.557252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4412f6861be4d24b7686d5346ff6227)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:12.566361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:12.793890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4412f6861be4d24b7686d5346ff6227', 'request_id': 'req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:12.839731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:12.840520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4412f6861be4d24b7686d5346ff6227', 'request_id': 'req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:12.843190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:12.858100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4412f6861be4d24b7686d5346ff6227', 'request_id': 'req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:12.908789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] The token cache is being invalidate because project c4412f6861be4d24b7686d5346ff6227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:12.908789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:12.908789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:12.914469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eff0d-4c1d-448c-9626-622b25b8b0f7 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:12.919826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 821/1640] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:12 2022] DELETE /identity/v3/projects/c4412f6861be4d24b7686d5346ff6227 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:12.921961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:12.925309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:13.073830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:13.075253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:13.075930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:13.076592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] PATH_INFO: `/v3/users/5fc6c6bcb9fe470584f3a538c727268e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:13.080597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc6c6bcb9fe470584f3a538c727268e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:13.085054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:13.172901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a44b3-05c1-4ae5-a2d8-f2d2e7c5780e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:13.179845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:13.180417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:13.180741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:13.181046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] PATH_INFO: `/v3/users/d6c1e1eb8db048b0b61d00fbd52ab61c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:13.182407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c1e1eb8db048b0b61d00fbd52ab61c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:13.183497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:13.183497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 20:14:13.183497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: Aug 29 20:14:13.184832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:13.253977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc6c6bcb9fe470584f3a538c727268e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.284386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc6c6bcb9fe470584f3a538c727268e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.298768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c1e1eb8db048b0b61d00fbd52ab61c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.299517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c1e1eb8db048b0b61d00fbd52ab61c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.323346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c1e1eb8db048b0b61d00fbd52ab61c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.331117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:13.346156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c1e1eb8db048b0b61d00fbd52ab61c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.346156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c1e1eb8db048b0b61d00fbd52ab61c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.354012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc6c6bcb9fe470584f3a538c727268e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.356538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc6c6bcb9fe470584f3a538c727268e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.359880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-81963a02-c15c-4de7-b97a-eebd6aad102e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc6c6bcb9fe470584f3a538c727268e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:13.410351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 820/1641] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:12 2022] DELETE /identity/v3/users/5fc6c6bcb9fe470584f3a538c727268e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:13.415986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:13.416772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:13.417592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:13.455523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 822/1642] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:12 2022] DELETE /identity/v3/users/d6c1e1eb8db048b0b61d00fbd52ab61c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:13.496982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:13.498872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:13.563182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:13.684113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 821/1643] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:13.828252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:13.830195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:14.076370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df0f69-6da1-4152-a846-5b6c5b8e5b2d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:14.092287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:14.094766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:14.122932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:14.126082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.129257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.130304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.154929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7696cde-795b-428c-a3e6-745a51ab5da1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:14.172571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:14.179489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1ea48-b8bf-4b11-a686-d66eaf7b9fd2 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:14.187704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:14.189004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.189767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.190420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] PATH_INFO: `/v3/users/99280ba1a6bc4bc89e18103962d5e710` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.196295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=99280ba1a6bc4bc89e18103962d5e710)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:14.201797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:14.247015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 823/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:14.425439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99280ba1a6bc4bc89e18103962d5e710'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:14.451254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99280ba1a6bc4bc89e18103962d5e710'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:14.485995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99280ba1a6bc4bc89e18103962d5e710'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:14.487124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99280ba1a6bc4bc89e18103962d5e710'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:14.488050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99280ba1a6bc4bc89e18103962d5e710'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:14.531723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 822/1645] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:14 2022] DELETE /identity/v3/users/99280ba1a6bc4bc89e18103962d5e710 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:14.540667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:14.541244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:14.541695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:14.602429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:14.604717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:14.780275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 824/1646] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:14.808159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:14.810536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:15.047357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2f87-0eef-4cbe-a814-becdb3cbd2ca admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:15.064359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:15.065487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:15.065966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:15.066444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:15.098700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:15.101677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15181b25-043f-4068-9fe9-9415bae1e1a7 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:15.153804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 823/1647] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:15.839548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:15.843795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:15.913917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fac5b-4d22-44ee-a207-6551b8f1e8db None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:15.938129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:15.942319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:15.943001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:15.943540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] PATH_INFO: `/v3/projects/c0d18e10f5b9422097e101d3c921f96e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:15.949558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d18e10f5b9422097e101d3c921f96e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:15.957894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:16.251216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d18e10f5b9422097e101d3c921f96e', 'request_id': 'req-22a682c8-63d8-4393-b454-ee4f5bfc26ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:16.265217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d18e10f5b9422097e101d3c921f96e', 'request_id': 'req-22a682c8-63d8-4393-b454-ee4f5bfc26ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:16.292799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d18e10f5b9422097e101d3c921f96e', 'request_id': 'req-22a682c8-63d8-4393-b454-ee4f5bfc26ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:16.324679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] The token cache is being invalidate because project c0d18e10f5b9422097e101d3c921f96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:16.325207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:16.333647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22a682c8-63d8-4393-b454-ee4f5bfc26ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:16.344627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 825/1648] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:15 2022] DELETE /identity/v3/projects/c0d18e10f5b9422097e101d3c921f96e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:16.352397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:16.353161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:16.353341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:16.434535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:16.436685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:16.642649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:16.747981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 824/1649] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:16.751617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:16.752089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:16.752546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:16.784473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:16.829654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:16.835240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:16.863262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 826/1650] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:16.867477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:16.896690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edee38f-0ef4-45dc-8011-40bbdf7e2211 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:16.941249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:16.943036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:16.949122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:16.951843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:16.954593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:16.958089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:16.970802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.022122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.035662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 825/1651] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:17.066078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a9115-185e-4fe2-99dc-093b713d2818 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.087741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:17.088814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:17.089278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:17.089731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:17.090980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:17.100395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.222107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 827/1652] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:17 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:17.227171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.247696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee719-bdd1-4b6b-8e01-a74b4cdc6fee admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.458020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:17.472963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:17.473710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:17.474572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:17.476098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:17.480597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.617545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.627170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 826/1653] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:17 2022] POST /identity/v3/users => generated 287 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:17.645840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.653844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8bd1-d65b-4dfc-a91c-a6401225906a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.654806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:17.690513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:17.698896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:17.698896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:17.698896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:17.698896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:17.708922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.716301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36efa89-74a6-4414-a27e-8495288923f5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.732883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:17.733675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:17.734302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:17.734578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] PATH_INFO: `/v3/projects/94f8d1031de242a2895acd6f7efa54a4` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:17.737460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f8d1031de242a2895acd6f7efa54a4)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:17.739406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 20:14:17.739406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 20:14:17.739406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: Aug 29 20:14:17.747776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.779567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 828/1654] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:17.781501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.820727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5777a5-7351-4899-99d6-4b562b7dca30 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.837397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:17.839075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:17.840070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:17.840888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:17.842326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:17.853713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:17.922215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 829/1655] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:17.924215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:17.955312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990348b3-cebd-49b1-b99a-c52a6fd31875 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:17.990299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f8d1031de242a2895acd6f7efa54a4', 'request_id': 'req-1f5ab361-f973-4ffd-9706-e65543fb0275'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:18.018993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f8d1031de242a2895acd6f7efa54a4', 'request_id': 'req-1f5ab361-f973-4ffd-9706-e65543fb0275'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:18.039070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f8d1031de242a2895acd6f7efa54a4', 'request_id': 'req-1f5ab361-f973-4ffd-9706-e65543fb0275'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:18.101545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] The token cache is being invalidate because project 94f8d1031de242a2895acd6f7efa54a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:18.102030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:18.103411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1f5ab361-f973-4ffd-9706-e65543fb0275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:18.105698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 827/1656] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:17 2022] DELETE /identity/v3/projects/94f8d1031de242a2895acd6f7efa54a4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:18.113929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f566-2b5b-400f-9446-86d7fad1496d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.115257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f566-2b5b-400f-9446-86d7fad1496d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.116700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f566-2b5b-400f-9446-86d7fad1496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.172265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a161f566-2b5b-400f-9446-86d7fad1496d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:18.173900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a161f566-2b5b-400f-9446-86d7fad1496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.183593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:18.189646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.190075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.190462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] PATH_INFO: `/v3/projects/bab5d3e81d644336ac5efac6f424129f/users/3e403d5e595d40789407a0796b5ad1a0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.228108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab5d3e81d644336ac5efac6f424129f, user_id=3e403d5e595d40789407a0796b5ad1a0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:18.231385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392eedb-e29e-4691-8e6e-b4ce2065c684 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:18.255909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:18.266578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 830/1657] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:17 2022] PUT /identity/v3/projects/bab5d3e81d644336ac5efac6f424129f/users/3e403d5e595d40789407a0796b5ad1a0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:18.285084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.285277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.285649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.356357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 828/1658] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:18.361992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] MFA Rules not processed for user `3e403d5e595d40789407a0796b5ad1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:18.365677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.366349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.366501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.366949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.448028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:18.449704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.555892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 831/1659] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:18.565934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:18.567951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:18.591399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d787c-ad4c-4c1f-be7e-c1dcf25522ba None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:18.595764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 829/1660] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:18.599340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:18.601536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:18.602344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.602760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.611454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.612458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:18.614618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:18.653353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1985d04-1439-4c91-8ed2-205ee3a1ddb2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:18.681368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:18.682933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.683581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.684379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.689511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 832/1661] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:18.690885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:18.692636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:18.693358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:18.697148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:18.707395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:18.743963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 830/1662] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:18.753656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:18.790967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446341d8-6c74-4b53-a5c2-9fedef1b6736 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:18.907565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfc6be-fece-443b-b8f1-c35935f5e97e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:18.919460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:18.923370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.949330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.951436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.953531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:18.966710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:18.985407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:18.986053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:18.986336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:18.986750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:18.987502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:18.989656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.025307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 833/1663] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:19.026924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.030166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.050920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596addc-ca3d-4489-8832-425d752f4563 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.055093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 831/1664] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:18 2022] POST /identity/v3/projects => generated 405 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:19.055946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.133518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.134184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.134465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.134739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] PATH_INFO: `/v3/projects/614b383c34ac435eb768f745481a771b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.136192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=614b383c34ac435eb768f745481a771b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.138469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.203089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:19.208272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2ef66-2012-45f9-b873-2e6ced3626cd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.244398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614b383c34ac435eb768f745481a771b', 'request_id': 'req-5016fb59-0bd4-4efb-bc54-e939764a4c4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:19.264610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614b383c34ac435eb768f745481a771b', 'request_id': 'req-5016fb59-0bd4-4efb-bc54-e939764a4c4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:19.276324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614b383c34ac435eb768f745481a771b', 'request_id': 'req-5016fb59-0bd4-4efb-bc54-e939764a4c4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:19.307455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] The token cache is being invalidate because project 614b383c34ac435eb768f745481a771b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:19.308903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:19.310563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:19.317343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 834/1665] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:19 2022] DELETE /identity/v3/projects/614b383c34ac435eb768f745481a771b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:19.319189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.321552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.340580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.341807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.342851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.342851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.343645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.347449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f56977-de58-4133-b838-cad90adcd423 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.375909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 832/1666] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:19.377575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.377858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.378138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.386821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:19.437351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:19.438767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.460170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 833/1667] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:19.462096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.464529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.512002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b42f-da1b-4c33-a2aa-d52d33b55274 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.543650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016fb59-0bd4-4efb-bc54-e939764a4c4e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.559617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.560572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.561021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.561427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.562427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.562806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.563936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.564385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.564778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] PATH_INFO: `/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3/users/7e571ab3dff049b4b4bdd46e6679a38b/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.569342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164acfad-de25-46f9-993e-0a52082b62a2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.605628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9543cc7c065b43ea9cf56fa65c052fb3, user_id=7e571ab3dff049b4b4bdd46e6679a38b, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.628124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 835/1668] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:19 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:19.628124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.628124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.628124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.641305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.679326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 834/1669] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:19 2022] PUT /identity/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3/users/7e571ab3dff049b4b4bdd46e6679a38b/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:19.681710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.682097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:19.683767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.699382 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:19.849209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 836/1670] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:19.850576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.875169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8e40-dec1-4be5-951d-b7f1a56a3cd0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.889610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.890321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.890599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.890868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.891548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.893263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.932456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 837/1671] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:19.933480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7c8d7-b549-4ec7-ac1a-845961650cbb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.933607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:19.952275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622dc2-d175-4a7c-a2d7-8a9480d0e44a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:19.954640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.955780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.956178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.956488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] PATH_INFO: `/v3/users/987a3768b7d449e3a732899b8358ac28` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.959744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987a3768b7d449e3a732899b8358ac28)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.966716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:19.973685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:19.974334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:19.974669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:19.975040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:19.975821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:19.977661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:20.002785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 838/1672] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:20.003991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:20.027913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95ee98-620c-4baf-ad94-93724aa210a6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:20.044380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:20.047678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:20.047678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:20.047678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:20.048112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:20.048112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:20.053470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:20.085230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 839/1673] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:20.092431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987a3768b7d449e3a732899b8358ac28'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:20.094885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:20.132828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987a3768b7d449e3a732899b8358ac28'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:20.152881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498356d4-b91a-41e6-b064-6e5d371d890f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:20.182875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:20.182875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:20.182875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:20.182875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:20.184003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:20.185737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:20.199976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:20.206577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987a3768b7d449e3a732899b8358ac28'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:20.208435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987a3768b7d449e3a732899b8358ac28'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:20.215777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987a3768b7d449e3a732899b8358ac28'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:20.251683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 840/1674] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:20.262045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:20.267122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:20.287320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 835/1675] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:19 2022] DELETE /identity/v3/users/987a3768b7d449e3a732899b8358ac28 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:20.288702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:20.316183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:20.382133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e7438-915b-4465-9cf6-20390679410b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:20.581527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:20.582258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:20.583488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:20.583488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] PATH_INFO: `/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3/users/7e571ab3dff049b4b4bdd46e6679a38b/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:20.598076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9543cc7c065b43ea9cf56fa65c052fb3, user_id=7e571ab3dff049b4b4bdd46e6679a38b, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:20.608597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:20.690141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 841/1676] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:20 2022] PUT /identity/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3/users/7e571ab3dff049b4b4bdd46e6679a38b/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:20.690680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:20.698440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:20.726879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:20.728860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b17fee-110f-4e5d-9688-ca18036e0559 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:20.989870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:20.991993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c117e-0793-4827-8d19-b1c291a44f31 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:20.992476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:20.992476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:20.992630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:20.994493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:20.998798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2513-66c5-4c35-9bde-69ae34070288 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.010618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:21.012347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.013379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.014433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] PATH_INFO: `/v3/projects/5e57bf8b94104314a80c0f607ff38efa/users/2193200eaac44e2f810fc6cc36616069/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.052283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e57bf8b94104314a80c0f607ff38efa, user_id=2193200eaac44e2f810fc6cc36616069, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:21.064434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b199a-15c1-43f2-ada6-27cacb68c125 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.087486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 836/1677] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:20 2022] POST /identity/v3/projects => generated 379 bytes in 800 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:21.091845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.091845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.092957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.111059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 842/1678] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:20 2022] PUT /identity/v3/projects/5e57bf8b94104314a80c0f607ff38efa/users/2193200eaac44e2f810fc6cc36616069/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:21.111059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c50f-a95a-4e4e-88b8-fa38ed3a6f86 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.111059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c50f-a95a-4e4e-88b8-fa38ed3a6f86 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.111059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c50f-a95a-4e4e-88b8-fa38ed3a6f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.161755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:21.163932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.239374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c98c50f-a95a-4e4e-88b8-fa38ed3a6f86 None None] MFA Rules not processed for user `7e571ab3dff049b4b4bdd46e6679a38b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:21.246407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c98c50f-a95a-4e4e-88b8-fa38ed3a6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.366342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 837/1679] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:21.370239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:21.396515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dbed8-c2bc-45ac-bbfd-fae0aa984e53 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:21.409795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:21.410518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.411132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.413144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.413980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:21.417434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809c9f2-733c-4827-b413-3f2945d5defd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.444576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 843/1680] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:21.456442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.459298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.459298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.477617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 838/1681] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:21 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:21.479886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.480338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.480840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.508598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:21.550208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:21.551563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.558123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] MFA Rules not processed for user `a48be8d8f3df4819bcaf18ddda2ef359`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:21.559422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.579286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 839/1682] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:21.580650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:21.589251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.730481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:21.739849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 844/1683] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:21.740796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:21.750704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.757809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdd3a2-aa08-48fc-8ba1-4f1589cb56a5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:21.771154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:21.771844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.774059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.774382 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.806165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:21.807587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.838209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 840/1684] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:21.839147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:21.894560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147000c-7925-439e-aba5-3fbd84aed8cb service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:21.896534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923763d5-9492-4567-9e25-1b6883fe006b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:21.911740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:21.912395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.914401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.914874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.922773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:21.927873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:21.928337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:21.928833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:21.931926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:21.933806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:21.933919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.936584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2923b1-a2f5-445a-b6e8-ccc4ee8ab558 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:21.953523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 845/1685] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:21.955368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:21.957552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:21.986362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00ffaa-1815-440f-882f-dafbc415d8af service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:22.001712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:22.002470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 841/1686] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:22.007754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.008424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.008869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.023540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.024601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.027953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.078212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:22.081512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:22.122404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] MFA Rules not processed for user `a48be8d8f3df4819bcaf18ddda2ef359`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:22.137260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:22.141328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 846/1687] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:22.146641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:22.168929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 842/1688] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:22.189305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:22.192058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:22.212373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d69cd-734f-4d0c-9444-ad3593993ebf service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:22.251101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:22.252177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.252658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.253142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.254243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:22.275700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:22.322767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 847/1689] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:22.324173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:22.340151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8ee8a-21ba-47eb-8cab-168da5527cdc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:22.346049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:22.346954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.347403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.347816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.351143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:22.466307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e93bd-653d-4acb-a61c-13c6bdf399f3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:22.489071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:22.490126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.490611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.491086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.504254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:22.507585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:22.524728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 848/1690] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:22.526092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:22.546578 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c1ee-4b97-4524-9f6a-cd761515f468 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:22.552103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:22.552791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:22.553551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.553892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.554268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] PATH_INFO: `/v3/projects/8fc958337804495ba306385397dd8cc8/users/c57f62fad96745cab35db43a3fcfdf67/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.570561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646f80b-866e-4265-a643-eb70750e7570 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:22.595336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc958337804495ba306385397dd8cc8, user_id=c57f62fad96745cab35db43a3fcfdf67, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:22.598442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:22.618047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 843/1691] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:22.668812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 849/1692] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:22 2022] PUT /identity/v3/projects/8fc958337804495ba306385397dd8cc8/users/c57f62fad96745cab35db43a3fcfdf67/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:22.679758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95e9-8c81-4a83-ad8a-e42b81c32bf8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:22.679758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95e9-8c81-4a83-ad8a-e42b81c32bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:22.680060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba95e9-8c81-4a83-ad8a-e42b81c32bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:22.756101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6cba95e9-8c81-4a83-ad8a-e42b81c32bf8 None None] MFA Rules not processed for user `c57f62fad96745cab35db43a3fcfdf67`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:22.758529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6cba95e9-8c81-4a83-ad8a-e42b81c32bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.037034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:23.061159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 844/1693] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:23.067575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:23.190053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:23.221699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.221979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.222249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:23.224471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2312-26d7-446e-b0a7-fc1e7e97e3cb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:23.269385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:23.271347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.271854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.272345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:23.281310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:23.287361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:23.351321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] MFA Rules not processed for user `2f6fbce6c07145b1815510bf9b8f2049`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:23.353722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.372638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 850/1694] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:23 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:23.374435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:23.581541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 845/1695] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:23.583920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:23.586993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.643647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224b969-c7d0-4aa5-acc4-28eccf194366 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:23.665273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:23.666286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.666754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.667176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:23.667971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:23.670115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:23.737209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 851/1696] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:23 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:23.738966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:23.751233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:23.847760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df04f9-ae2a-4547-8f41-5a3691259d1d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:23.866968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:23.869243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.872143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.875286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] PATH_INFO: `/v3/projects/713dc968d193462ab7c611a89022107e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:23.880589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=713dc968d193462ab7c611a89022107e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:23.885260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:23.960093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c9bd8-c617-4532-bf6e-6c487274ce36 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:23.983344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:23.986414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:23.987461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:23.987852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:24.021215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:24.023395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:24.041665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713dc968d193462ab7c611a89022107e', 'request_id': 'req-767f1c29-89ae-4060-8758-8c29cafa0b7a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:24.054322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 852/1697] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:24.055337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:24.064561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713dc968d193462ab7c611a89022107e', 'request_id': 'req-767f1c29-89ae-4060-8758-8c29cafa0b7a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:24.083302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713dc968d193462ab7c611a89022107e', 'request_id': 'req-767f1c29-89ae-4060-8758-8c29cafa0b7a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:24.088181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9989ed2-57bc-4e7e-a566-2255abf37548 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:24.117399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] The token cache is being invalidate because project 713dc968d193462ab7c611a89022107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:24.117712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:24.119981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-767f1c29-89ae-4060-8758-8c29cafa0b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:24.128116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 846/1698] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:23 2022] DELETE /identity/v3/projects/713dc968d193462ab7c611a89022107e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:24.130665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88e91-0ff4-448e-b74f-eeea972c600e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:24.130905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88e91-0ff4-448e-b74f-eeea972c600e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:24.131190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb88e91-0ff4-448e-b74f-eeea972c600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:24.189526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-eeb88e91-0ff4-448e-b74f-eeea972c600e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:24.195170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eeb88e91-0ff4-448e-b74f-eeea972c600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:24.248368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:24.307302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:24.330645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:24.332897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:24.333187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:24.333475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:24.334298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:24.342143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:24.380997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 853/1699] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:24.386822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:24.393825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:24.446780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3fa5c-24c3-47cb-b557-b11763ed7d99 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:24.449385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 847/1700] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:24.465574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:24.466023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:24.466487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:24.480721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:24.481835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:24.482438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:24.482752 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] PATH_INFO: `/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9/users/6b831ffdf34f402b8e6cd78b268e6386/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:24.597313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:24.599451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:24.608718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3246d4ed5947e2aa01fd86729ca1b9, user_id=6b831ffdf34f402b8e6cd78b268e6386, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:24.634700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:24.654416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 848/1701] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:24.676429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:24.717034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 854/1702] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:24 2022] PUT /identity/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9/users/6b831ffdf34f402b8e6cd78b268e6386/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:24.719636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:24.721592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a48e7-3f74-4ebc-92a9-ded6f78d3151 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:24.995292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7a7f-1608-45eb-827f-ba409d240254 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:25.019444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:25.021617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.022793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.023127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.026568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:25.031086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:25.075883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 855/1703] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:25.081779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:25.093692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:25.094796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.095285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.096927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.100230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:25.100781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:25.105866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:25.143728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e8bd3-b927-4dec-a69b-c85c35670749 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:25.164139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 849/1704] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:25.165753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:25.190373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:25.192296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.192801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.193669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] PATH_INFO: `/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9/users/6b831ffdf34f402b8e6cd78b268e6386/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.203588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3246d4ed5947e2aa01fd86729ca1b9, user_id=6b831ffdf34f402b8e6cd78b268e6386, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:25.223982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0d145-ad87-46b0-98db-cc20fb3d667a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:25.246113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c436-6991-401b-91a1-4724a75963ee admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:25.279161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:25.285939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.286462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.287514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.288715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:25.292570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 856/1705] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:25 2022] PUT /identity/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9/users/6b831ffdf34f402b8e6cd78b268e6386/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:25.304423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:25.322198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.322845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.323264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.412091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] MFA Rules not processed for user `6b831ffdf34f402b8e6cd78b268e6386`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:25.414595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:25.523869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 850/1706] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:25 2022] POST /identity/v3/projects => generated 355 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:25.537724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:25.723379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 857/1707] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:25.744363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:25.746494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:25.870515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d15d6-c3b6-40d7-8318-81a3411bcfe0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:25.887371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:25.888173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:25.888454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:25.889931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:25.892200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:25.895844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:25.939341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:25.947993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 851/1708] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:25 2022] POST /identity/v3/users => generated 278 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:25.953598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:25.997677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec96a95-00f3-4f14-81fd-4cdfa253ec7e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:26.018892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:26.019921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.021141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.023916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.027047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:26.029428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:26.036283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe20277-344c-47c9-9807-38322dc4890b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:26.090998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 852/1709] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:26.099578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:26.107443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:26.146830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc963-0014-4a63-9971-4e50a5529cbd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:26.162022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:26.165184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.166487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.166927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.169800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:26.173902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:26.215022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 853/1710] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:26.222896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:26.263020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:26.264479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.265720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.266645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132dfd1-5a47-4f6e-9ec1-f27c62f03a3d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:26.267169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.285252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:26.289544 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.293194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.294620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] PATH_INFO: `/v3/projects/073d1666a2174e0ebbe8043e7c7d3027/users/6ae9cc63ad19492d83ae7f906276f551/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.389519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073d1666a2174e0ebbe8043e7c7d3027, user_id=6ae9cc63ad19492d83ae7f906276f551, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:26.408359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba26bc7-d083-43d7-b9f0-6a34c7fb6a45 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:26.480190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 854/1711] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:26 2022] PUT /identity/v3/projects/073d1666a2174e0ebbe8043e7c7d3027/users/6ae9cc63ad19492d83ae7f906276f551/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:26.503323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.504071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.504559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.573110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:26.576961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc29ed-df11-4fef-822e-e037d52e77e8 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:26.620067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] MFA Rules not processed for user `6ae9cc63ad19492d83ae7f906276f551`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:26.623647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:26.640869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 858/1712] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 897 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:26.643470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb8e2-5e26-4828-a730-4fef36e32ab6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.647139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb8e2-5e26-4828-a730-4fef36e32ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.649142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eb8e2-5e26-4828-a730-4fef36e32ab6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.654726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 859/1713] 10.222.0.61 () {54 vars in 912 bytes} [Mon Aug 29 20:14:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:26.671998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:26.672533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:26.673332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:26.801771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:26.803222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:26.970150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 855/1714] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:26.972076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:26.974479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:27.047941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 860/1715] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:27.052836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:27.131024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fc6f-bcca-41db-ae6c-b220d953ac6b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:27.144874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:27.145710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:27.146090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:27.146462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:27.152250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:27.243169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:27.381847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:27.384188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:27.386726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e62bba-10d9-4415-b988-29fea5e75f18 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:27.399459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:27.400902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:27.401358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:27.401810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:27.407915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:27.422653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:27.427636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 856/1716] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:27.543664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 861/1717] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:27 2022] POST /identity/v3/projects => generated 357 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:27.544081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:27.582819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4c99-14f8-4960-850d-076bece7d483 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:27.629551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:27.634733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:27.652761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:27.972552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:27.974457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:27.974753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:27.975089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:27.980069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:27.985305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe271-3e46-4ba0-b72b-736a31ef82e6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:27.996916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.005155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.006217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.006697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.007742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.054503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.058705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.092665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 862/1718] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:28.103563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 857/1719] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:27 2022] POST /identity/v3/users => generated 285 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:28.109662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:28.142828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e7c86-3f38-4774-9e8d-f332293de7dd service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:28.156411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.158433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.158908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.159519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.162136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.174691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.200018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 863/1720] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:28.206232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:28.239821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb49e-be05-45fb-b5f6-21ec2855be24 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:28.264422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.267019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.267909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.269526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] PATH_INFO: `/v3/projects/508fee39c87947c593b7d31fe655cc0b/users/f534335eb25443548c1415e4b05db9a8/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.369115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508fee39c87947c593b7d31fe655cc0b, user_id=f534335eb25443548c1415e4b05db9a8, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.386585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.438500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 858/1721] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:28 2022] PUT /identity/v3/projects/508fee39c87947c593b7d31fe655cc0b/users/f534335eb25443548c1415e4b05db9a8/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:28.443887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:28.452186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:28.466124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a4a73-8227-4480-983a-3a2912f92056 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:28.662019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.663242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.663242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.663496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.668477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.671856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a88a7-c998-4ccd-8d03-4b281bfc1aa8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:28.679279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.687757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.688903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.689385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.689686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] PATH_INFO: `/v3/users/c57f62fad96745cab35db43a3fcfdf67` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.700892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57f62fad96745cab35db43a3fcfdf67)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.700892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.701997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 864/1722] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:14:28.708822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:28.732433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720681af-e6a3-452d-80eb-59153b320b03 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:28.744356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:28.746162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.746418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.746687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] PATH_INFO: `/v3/projects/508fee39c87947c593b7d31fe655cc0b/users/f534335eb25443548c1415e4b05db9a8/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.754321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508fee39c87947c593b7d31fe655cc0b, user_id=f534335eb25443548c1415e4b05db9a8, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:28.759713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab97de-6c3c-4b40-8f23-c24856a0d173 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:28.794557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 865/1723] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:28 2022] PUT /identity/v3/projects/508fee39c87947c593b7d31fe655cc0b/users/f534335eb25443548c1415e4b05db9a8/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:28.808180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.808510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.808770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.826270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57f62fad96745cab35db43a3fcfdf67'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:28.848049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57f62fad96745cab35db43a3fcfdf67'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:28.892063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57f62fad96745cab35db43a3fcfdf67'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:28.894045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57f62fad96745cab35db43a3fcfdf67'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:28.896085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cd73beac-fb7b-46d2-9436-2df1850d5ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57f62fad96745cab35db43a3fcfdf67'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:28.905650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] MFA Rules not processed for user `f534335eb25443548c1415e4b05db9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:28.911050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:28.915396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:28.942931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 859/1724] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:28 2022] DELETE /identity/v3/users/c57f62fad96745cab35db43a3fcfdf67 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:28.945281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:28.945892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:28.946175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:28.978211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:29.001714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:29.003307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:29.149709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 866/1725] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:29.194808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:29.197002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:29.210096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 860/1726] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:29.252582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:29.254221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:29.393870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f93d-bdf3-407e-9eb0-d48ab73d167e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:29.396605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78990f0a-9dc3-4913-998e-56d1233a7bc2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:29.417686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:29.420077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:29.420539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:29.420859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:29.454138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:29.456917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a0e2-13d5-41a1-85d2-8d7d3b9f7ac2 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:29.523868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 861/1727] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:29.595827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:29.596393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:29.596657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:29.599158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:29.625786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851e8c-0578-4905-8799-6a2602e6f486 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:29.626974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851e8c-0578-4905-8799-6a2602e6f486 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:29.626974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8851e8c-0578-4905-8799-6a2602e6f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:29.696058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f8851e8c-0578-4905-8799-6a2602e6f486 None None] MFA Rules not processed for user `2f6fbce6c07145b1815510bf9b8f2049`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:29.699756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f8851e8c-0578-4905-8799-6a2602e6f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:29.736052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:29.738907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:29.766962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 867/1728] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:29.955352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 862/1729] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:29.987343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:30.000661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebddaf-b43b-42d9-a0d0-ccd626aa81fd service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:30.013342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:30.014262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:30.014652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:30.016082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:30.021569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:30.098521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:30.226535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:30.230025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a740-e3c3-43d6-ae49-6b0be103fd89 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:30.262048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 868/1730] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:31.079656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.079656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.080540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.081348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 863/1731] 10.222.0.61 () {54 vars in 912 bytes} [Mon Aug 29 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:31.099271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.100187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.100187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.171726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:31.175160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.208273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 869/1732] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:31.246737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:31.252376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.326078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d8bdf-b1ed-46c8-8571-044b6ba53dc1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:31.350835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:31.352114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.352886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.354120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.381857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:31.384559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83101368-778b-43e5-8dae-fce5650ee03d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:31.396774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 864/1733] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:31.655842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:31.657561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.689662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.690163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.690567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.778309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] MFA Rules not processed for user `2193200eaac44e2f810fc6cc36616069`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:31.779719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.830703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:31.842011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d9113-43ff-4c51-a044-4f1495a067fa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:31.859871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:31.860630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:31.861030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:31.861395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:31.863654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:31.894917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:31.896199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:31.926680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 870/1734] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:31.986752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 865/1735] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:31.993442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:31.995041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:32.018534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5782f36-18ab-4c37-bf7e-607ddbc6ef94 service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:32.037102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:32.037890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:32.038286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:32.038680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:32.039442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:32.042272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:32.142987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 871/1736] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:31 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:32.144729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:32.181824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25022c3f-dbb4-4c46-9850-414fd7e44027 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:32.432975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:32.437495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:32.438029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:32.438871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:32.439940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:32.461718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:32.563878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 866/1737] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:32 2022] POST /identity/v3/users => generated 309 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:32.570037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:32.592466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5915d1-0324-42ef-aa6d-4d0454123a2a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:32.601654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:32.602765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:32.603431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:32.603824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:32.604656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:32.609723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:32.626987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 872/1738] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:32.633295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:32.654625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b6e8d-10b2-4f1e-9437-8a89d60c297b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:32.666191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:32.666898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:32.667177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:32.670014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] PATH_INFO: `/v3/projects/10cb01e7e311440d92db32d8b4210949/users/d470f382277a49139de33a6efe5c89d1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:32.778777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cb01e7e311440d92db32d8b4210949, user_id=d470f382277a49139de33a6efe5c89d1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:32.790429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:32.829364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 867/1739] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:32 2022] PUT /identity/v3/projects/10cb01e7e311440d92db32d8b4210949/users/d470f382277a49139de33a6efe5c89d1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:32.830355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:32.855546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0712d9-532e-4a8d-b027-749ca4190fe0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:33.104132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:33.106451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:33.106734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:33.107208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:33.108043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:33.116560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:33.127661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:33.130707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:33.173509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 873/1740] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:14:33.173509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:33.192881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e31ed-0f51-4e09-af18-38143cd25b72 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:33.204881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6b9d6-5069-4aaf-8e7c-5c2445f1725d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:33.207898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:33.209029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:33.209621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:33.211590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] PATH_INFO: `/v3/projects/8fc958337804495ba306385397dd8cc8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:33.213543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc958337804495ba306385397dd8cc8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:33.218843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:33.222097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:33.223161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:33.224003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:33.225156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] PATH_INFO: `/v3/projects/10cb01e7e311440d92db32d8b4210949/users/d470f382277a49139de33a6efe5c89d1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:33.231688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cb01e7e311440d92db32d8b4210949, user_id=d470f382277a49139de33a6efe5c89d1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:33.246594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:33.271002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:33.305168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 874/1741] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:33 2022] PUT /identity/v3/projects/10cb01e7e311440d92db32d8b4210949/users/d470f382277a49139de33a6efe5c89d1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:33.419031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc958337804495ba306385397dd8cc8', 'request_id': 'req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:33.477878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc958337804495ba306385397dd8cc8', 'request_id': 'req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:33.513091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc958337804495ba306385397dd8cc8', 'request_id': 'req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:33.557979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] The token cache is being invalidate because project 8fc958337804495ba306385397dd8cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:33.563443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:33.564607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ebec5475-7715-41a5-9bc2-fa5252fb6b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:33.568484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 868/1742] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:33 2022] DELETE /identity/v3/projects/8fc958337804495ba306385397dd8cc8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:33.575469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:33.581522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:34.018122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f2718-b4f0-408b-830e-499088e25b0a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:34.219861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:34.224905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:34.228766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:34.229294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] PATH_INFO: `/v3/users/6b831ffdf34f402b8e6cd78b268e6386` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:34.235576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b831ffdf34f402b8e6cd78b268e6386)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:34.240668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:34.292843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb774d5-74d6-439a-92a9-af39cee752b7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:34.293989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb774d5-74d6-439a-92a9-af39cee752b7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:34.294552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb774d5-74d6-439a-92a9-af39cee752b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:34.353375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:34.411654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7bb774d5-74d6-439a-92a9-af39cee752b7 None None] MFA Rules not processed for user `cc68601c71074f1b86b9698193289f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:34.415054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7bb774d5-74d6-439a-92a9-af39cee752b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:34.487276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b831ffdf34f402b8e6cd78b268e6386'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:34.488684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b831ffdf34f402b8e6cd78b268e6386'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:34.548180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b831ffdf34f402b8e6cd78b268e6386'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:34.587496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b831ffdf34f402b8e6cd78b268e6386'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:34.589915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-697b367f-ff52-4fe6-8939-79c92f10f5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b831ffdf34f402b8e6cd78b268e6386'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:34.753524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 875/1743] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:33 2022] DELETE /identity/v3/users/6b831ffdf34f402b8e6cd78b268e6386 => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:34.911786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 869/1744] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 622 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:34.922594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:34.922871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:34.923138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:35.034122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] MFA Rules not processed for user `cc68601c71074f1b86b9698193289f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:35.035720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:35.131307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:35.199061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:35.199714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:35.200277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:35.326902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] MFA Rules not processed for user `e3cc61673b284d8dae02a659a6635adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:35.332071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:35.334975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 876/1745] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:35.345959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:35.349287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:35.609405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 870/1746] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:35.647362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8f99-1431-4210-9fca-8fb173ed64e1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:35.667265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:35.668076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:35.669204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:35.669634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:35.714118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:35.717519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:35.751105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 877/1747] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:35.987840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:35.990134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.227362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01834d74-3e42-47ea-a583-bfdc103b3a5b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:36.236600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:36.237844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.238413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.238833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] PATH_INFO: `/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.241075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3246d4ed5947e2aa01fd86729ca1b9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:36.243337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:36.316375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:36.360124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:36.362234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.388191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba733f68-9984-42bc-9c91-62313ab5d66b service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:36.410031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3246d4ed5947e2aa01fd86729ca1b9', 'request_id': 'req-08700fe0-249d-4160-8e88-3799004e8e50'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:36.434385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3246d4ed5947e2aa01fd86729ca1b9', 'request_id': 'req-08700fe0-249d-4160-8e88-3799004e8e50'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:36.459573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3246d4ed5947e2aa01fd86729ca1b9', 'request_id': 'req-08700fe0-249d-4160-8e88-3799004e8e50'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:36.489296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] The token cache is being invalidate because project 4d3246d4ed5947e2aa01fd86729ca1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:36.489609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:36.494638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-08700fe0-249d-4160-8e88-3799004e8e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:36.497207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 871/1748] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:35 2022] DELETE /identity/v3/projects/4d3246d4ed5947e2aa01fd86729ca1b9 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:36.503385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37833b-bb6a-44b6-8304-35e6c0a81c96 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.503787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37833b-bb6a-44b6-8304-35e6c0a81c96 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.504151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37833b-bb6a-44b6-8304-35e6c0a81c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.584066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:36.584738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6a37833b-bb6a-44b6-8304-35e6c0a81c96 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:36.584995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.585276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.585547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.586467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6a37833b-bb6a-44b6-8304-35e6c0a81c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.593754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.795238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 872/1749] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:36.815679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:36.816060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:36.816341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:36.822163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:36.887617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:36.905737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:36.920395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:36.923911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:36.949274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 878/1750] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:36.959548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 873/1751] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:36.962883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:36.996342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a7fcc-d098-4006-bc8a-63f3e69bb16a service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:37.038154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:37.043019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.048046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.049461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.050632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:37.067393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:37.076848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:37.181283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:37.189778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 879/1752] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:14:37.221869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0212-3875-41ec-b584-e510f9f5a735 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:37.275076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:37.276916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.276916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.283545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.298465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:37.308995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf4cf5-df20-4e21-9313-b3f885df2833 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:37.403000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 874/1753] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:37 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:14:37.407426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:37.418752 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f19b2-d920-4e7a-a31b-f7e28490c886 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:37.451682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.453289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.453938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.692333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] MFA Rules not processed for user `d470f382277a49139de33a6efe5c89d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:37.699190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:37.955502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:37.963436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:37.979074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:37.981783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:37.982593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:37.998860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cd9bc-b215-4573-bc7b-ab6a9a94dad8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:38.212942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 880/1754] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:37 2022] POST /identity/v3/users => generated 289 bytes in 806 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:38.215517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea683470-3d3f-45d2-bf4a-7b62a4aa2b8c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.215992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea683470-3d3f-45d2-bf4a-7b62a4aa2b8c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.216604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea683470-3d3f-45d2-bf4a-7b62a4aa2b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.230602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 875/1755] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 781 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:38.231899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:38.275385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201632f-18d9-4de1-b150-04d80644c73a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:38.289342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:38.290733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.291102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.293228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.294113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:38.306817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:38.340206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 876/1756] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:38.341557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:38.360567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:38.367519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf490aa2-305c-4d9d-8f11-16cca1032725 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:38.386732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:38.389606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.391140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.392272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.394721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:38.400708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:38.466006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 877/1757] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:38.472477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:38.542079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2a01-c165-4bf4-a813-8569e614d56a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:38.561283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ea683470-3d3f-45d2-bf4a-7b62a4aa2b8c None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:38.567375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ea683470-3d3f-45d2-bf4a-7b62a4aa2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:38.572224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:38.579631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.580444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.582444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] PATH_INFO: `/v3/projects/a4d72f4f266b45b5bfd34fc3dd4c3fb4/users/55ee260f2fac427cbbfb52d2ecece7d5/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.685925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d72f4f266b45b5bfd34fc3dd4c3fb4, user_id=55ee260f2fac427cbbfb52d2ecece7d5, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:38.700185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a39cb7-1156-4bcc-b462-9f00a7c956b8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:38.769280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 878/1758] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:38 2022] PUT /identity/v3/projects/a4d72f4f266b45b5bfd34fc3dd4c3fb4/users/55ee260f2fac427cbbfb52d2ecece7d5/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:38.791292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:38.791815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:38.792722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:38.812447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 881/1759] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:38.877919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] MFA Rules not processed for user `55ee260f2fac427cbbfb52d2ecece7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:38.879874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.030355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.031087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.031484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.069198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] MFA Rules not processed for user `cc68601c71074f1b86b9698193289f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:39.070495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.147674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 879/1760] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:39.154507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:39.163185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:39.168313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.283653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 882/1761] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:39.283653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:39.287189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:39.421400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8f427-735d-4efa-93bc-96b7c19b342d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:39.429246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:39.431291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.431695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.432071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.470813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:39.480178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6d636-082b-4311-bf50-f55c71d67161 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:39.548809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 880/1762] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:39.609445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec53b-b0d0-4e8f-823d-5d207cee2c7a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:39.635722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:39.644548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:39.645022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:39.645563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:39.928880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:39.942005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:40.016390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 883/1763] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:44.420342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7de87-dba2-40e6-9fe1-2840bc800d57 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:44.421539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7de87-dba2-40e6-9fe1-2840bc800d57 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:44.421539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7de87-dba2-40e6-9fe1-2840bc800d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:44.471529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28f7de87-dba2-40e6-9fe1-2840bc800d57 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:44.478655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28f7de87-dba2-40e6-9fe1-2840bc800d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:44.516562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 881/1764] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:14:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:44.527883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:44.553382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd72f0-bb42-4f8f-beb6-7777f992dd99 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:44.572251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:44.573421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:44.574675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:44.576917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:44.637859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:44.644329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cafc8-c92c-456c-b60b-ccb42f7582ba service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:44.704815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 884/1765] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:14:45.151617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4705e-f8ca-4d1b-a93b-90d51f8a15ef None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:45.153209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4705e-f8ca-4d1b-a93b-90d51f8a15ef None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:45.154229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4705e-f8ca-4d1b-a93b-90d51f8a15ef None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:45.157849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 882/1766] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:14:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:45.630500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3f85-64c1-4899-8983-d6bf787e80c1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:45.631099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3f85-64c1-4899-8983-d6bf787e80c1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:45.631099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba3f85-64c1-4899-8983-d6bf787e80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:45.717045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e8ba3f85-64c1-4899-8983-d6bf787e80c1 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:45.718681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8ba3f85-64c1-4899-8983-d6bf787e80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:45.901901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:45.942846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 885/1767] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:14:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:46.146384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325549d1-5a68-4062-8aa6-06d896b8ae3c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:46.147665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325549d1-5a68-4062-8aa6-06d896b8ae3c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:46.147665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325549d1-5a68-4062-8aa6-06d896b8ae3c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:46.148786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 883/1768] 10.222.0.61 () {54 vars in 961 bytes} [Mon Aug 29 20:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:14:46.161395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb12-a005-4a55-bff1-f884051e966f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:46.161684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb12-a005-4a55-bff1-f884051e966f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:46.161933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19cb12-a005-4a55-bff1-f884051e966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:46.277812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4f19cb12-a005-4a55-bff1-f884051e966f None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:46.314490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4f19cb12-a005-4a55-bff1-f884051e966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:46.379866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325549d1-5a68-4062-8aa6-06d896b8ae3c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:46.381021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 886/1769] 10.222.0.61 () {58 vars in 1058 bytes} [Mon Aug 29 20:14:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:46.428152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325549d1-5a68-4062-8aa6-06d896b8ae3c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:46.445731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:46.446421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:46.446731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:46.447230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:46.506869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:46.509264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:46.558510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 884/1770] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:14:47.509389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593f5-1c2d-4622-9675-f0ad1d6cb07c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:47.511284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593f5-1c2d-4622-9675-f0ad1d6cb07c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:47.512142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593f5-1c2d-4622-9675-f0ad1d6cb07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:47.652202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c07593f5-1c2d-4622-9675-f0ad1d6cb07c None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:47.659162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c07593f5-1c2d-4622-9675-f0ad1d6cb07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:47.982847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 887/1771] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 20:14:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:48.068516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:48.071166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:48.099013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d8a0f-01b2-4c04-a043-6aec82249cc4 service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:48.110944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:48.112449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:48.112967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:48.114557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:48.140850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:48.144333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9679f6b-cb45-46dd-9d06-384b818e2ce8 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:48.167968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 885/1772] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:51.842427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac7c5-8fb3-4b84-bc19-956322dffba5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:51.843033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac7c5-8fb3-4b84-bc19-956322dffba5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:51.843452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac7c5-8fb3-4b84-bc19-956322dffba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:51.925550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0abac7c5-8fb3-4b84-bc19-956322dffba5 None None] MFA Rules not processed for user `e3cc61673b284d8dae02a659a6635adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:51.951404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0abac7c5-8fb3-4b84-bc19-956322dffba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:52.187163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 888/1773] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:52.766164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:52.767050 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:52.772029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:52.775276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 886/1774] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:14:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:53.025294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:53.026110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:53.026234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:53.121828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:53.125453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:53.481322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 889/1775] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:14:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:54.071319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:54.073885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:54.116094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:54.270355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe347d-3138-40ef-85b3-c318f933caf2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:54.291147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:54.300365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:54.301545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:54.303523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] PATH_INFO: `/v3/users/2193200eaac44e2f810fc6cc36616069` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:54.312079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2193200eaac44e2f810fc6cc36616069)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:54.316548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:54.503295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2193200eaac44e2f810fc6cc36616069'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:54.544803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2193200eaac44e2f810fc6cc36616069'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:54.602288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2193200eaac44e2f810fc6cc36616069'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:54.603715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2193200eaac44e2f810fc6cc36616069'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:54.606160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2193200eaac44e2f810fc6cc36616069'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:54.663202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 887/1776] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:54 2022] DELETE /identity/v3/users/2193200eaac44e2f810fc6cc36616069 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:54.809355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:54.810927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:54.846191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b8a7b-9681-4588-9182-1a46ebcdb592 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:54.925076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:55.118038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:55.119222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:55.119716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:55.120492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:55.125043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:55.186498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:55.196652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:55.254838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 890/1777] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:55.583761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:55.586280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:55.792955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afa944-24e4-437c-ab19-9548feec1617 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:55.798301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:55.798970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:55.799252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:55.799584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] PATH_INFO: `/v3/projects/5e57bf8b94104314a80c0f607ff38efa` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:55.801189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e57bf8b94104314a80c0f607ff38efa)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:55.803212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:55.892686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:56.047668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e57bf8b94104314a80c0f607ff38efa', 'request_id': 'req-d7233728-52a8-4518-b7e8-7c33dd99c471'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.070280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e57bf8b94104314a80c0f607ff38efa', 'request_id': 'req-d7233728-52a8-4518-b7e8-7c33dd99c471'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.093219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e57bf8b94104314a80c0f607ff38efa', 'request_id': 'req-d7233728-52a8-4518-b7e8-7c33dd99c471'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.193626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] The token cache is being invalidate because project 5e57bf8b94104314a80c0f607ff38efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:56.205385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.206727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.210641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 888/1778] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:55 2022] DELETE /identity/v3/projects/5e57bf8b94104314a80c0f607ff38efa => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:56.214839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:56.240988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b5f69-29c6-4735-82b8-73ca49c343e3 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:56.406696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:56.409576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:56.410113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:56.411683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] PATH_INFO: `/v3/users/d470f382277a49139de33a6efe5c89d1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:56.414108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d470f382277a49139de33a6efe5c89d1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:56.417766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:56.570420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd470f382277a49139de33a6efe5c89d1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.572174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd470f382277a49139de33a6efe5c89d1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.589412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd470f382277a49139de33a6efe5c89d1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.624194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd470f382277a49139de33a6efe5c89d1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.627092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4b29daad-60ba-4249-b14d-661b4db284e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd470f382277a49139de33a6efe5c89d1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:56.668126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:56.669724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:56.695238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 891/1779] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:56 2022] DELETE /identity/v3/users/d470f382277a49139de33a6efe5c89d1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:56.712851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7233728-52a8-4518-b7e8-7c33dd99c471 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:56.891357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:56.893607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:56.894994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:56.895528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] PATH_INFO: `/v3/users/6ae9cc63ad19492d83ae7f906276f551` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:56.901252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae9cc63ad19492d83ae7f906276f551)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:56.910377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:57.021145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7aa7-ee60-4d03-9162-c4a432703507 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:57.022596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7aa7-ee60-4d03-9162-c4a432703507 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:57.023508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7aa7-ee60-4d03-9162-c4a432703507 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:57.026815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 892/1780] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:14:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:14:57.037257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae9cc63ad19492d83ae7f906276f551'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:57.048564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae9cc63ad19492d83ae7f906276f551'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:57.065904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae9cc63ad19492d83ae7f906276f551'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:57.066841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae9cc63ad19492d83ae7f906276f551'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:57.067892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-acd17768-39d9-48c9-a583-29f92795f5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae9cc63ad19492d83ae7f906276f551'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:57.098568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 889/1781] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:56 2022] DELETE /identity/v3/users/6ae9cc63ad19492d83ae7f906276f551 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:14:57.101496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:57.102414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:57.103568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:57.122046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:57.123682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:57.124485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:57.162475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:57.166859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:57.210188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:57.211672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:57.270634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:57.296345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:57.357565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 890/1782] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:14:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:57.360423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 893/1783] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:57.373016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:57.374986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:57.475939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12544d-4b22-4041-9ec7-02f1f811ddff None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:57.481137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:57.482035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:57.482719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:57.483979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:57.497545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:57.499729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:57.513363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 891/1784] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:57.610559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:57.620259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:57.642349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413a82-5e45-444f-b9b9-db716eccb1c6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:57.651339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:57.652488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:57.653016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:57.653458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:57.672478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:57.675541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:57.695940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 894/1785] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:14:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:14:58.165267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:58.167608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:58.182433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3c61-72cb-45f9-a2d3-4f8bdc823c69 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:58.192995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:58.192995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.192995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.192995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] PATH_INFO: `/v3/projects/073d1666a2174e0ebbe8043e7c7d3027` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.194286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] RBAC: Authorizing `identity:delete_project(project_id=073d1666a2174e0ebbe8043e7c7d3027)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:58.196327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:58.270420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073d1666a2174e0ebbe8043e7c7d3027', 'request_id': 'req-c9ce3544-ac67-4ba1-be20-066f84c7529b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.280153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073d1666a2174e0ebbe8043e7c7d3027', 'request_id': 'req-c9ce3544-ac67-4ba1-be20-066f84c7529b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.287341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073d1666a2174e0ebbe8043e7c7d3027', 'request_id': 'req-c9ce3544-ac67-4ba1-be20-066f84c7529b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.305724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] The token cache is being invalidate because project 073d1666a2174e0ebbe8043e7c7d3027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:58.306442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.307267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.309331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 892/1786] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:58 2022] DELETE /identity/v3/projects/073d1666a2174e0ebbe8043e7c7d3027 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:58.313626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:58.329614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea33720-b0c5-43fd-8032-1107ce45f084 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:58.344338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:58.347095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:58.487117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:58.491334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3544-ac67-4ba1-be20-066f84c7529b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:58.497198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:58.497957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.498231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.498528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] PATH_INFO: `/v3/users/f534335eb25443548c1415e4b05db9a8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.499845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f534335eb25443548c1415e4b05db9a8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:58.500489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:58.501717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.502448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.502613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:58.503064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] PATH_INFO: `/v3/projects/10cb01e7e311440d92db32d8b4210949` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.504486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cb01e7e311440d92db32d8b4210949)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:58.509449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:58.577515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f534335eb25443548c1415e4b05db9a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.577849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f534335eb25443548c1415e4b05db9a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.587146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f534335eb25443548c1415e4b05db9a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.598312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f534335eb25443548c1415e4b05db9a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.598677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e35133f8-8ea1-437d-bac9-10d5bf8033bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f534335eb25443548c1415e4b05db9a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.598789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cb01e7e311440d92db32d8b4210949', 'request_id': 'req-ca17cf30-c67c-454d-9066-bf1f0585b822'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.609410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cb01e7e311440d92db32d8b4210949', 'request_id': 'req-ca17cf30-c67c-454d-9066-bf1f0585b822'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.627505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cb01e7e311440d92db32d8b4210949', 'request_id': 'req-ca17cf30-c67c-454d-9066-bf1f0585b822'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.629470 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 895/1787] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:14:58 2022] DELETE /identity/v3/users/f534335eb25443548c1415e4b05db9a8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:58.671538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] The token cache is being invalidate because project 10cb01e7e311440d92db32d8b4210949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:14:58.672169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.673210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca17cf30-c67c-454d-9066-bf1f0585b822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:14:58.679433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 893/1788] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:58 2022] DELETE /identity/v3/projects/10cb01e7e311440d92db32d8b4210949 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:58.680522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.680853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.681557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.720006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:58.721397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:58.770790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:58.809919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 896/1789] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:14:58.818495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.818773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.819688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.842073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:58.844679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:58.860178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:58.866401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 894/1790] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:58.873735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb070-1bce-4d02-b7e3-e60f3f01c4e4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:58.880411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:58.881170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.881517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.881848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.882732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:14:58.883088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:58.884877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:58.907879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 897/1791] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:14:58.909882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:58.945791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2b04-bde1-4b98-97ff-f17f04228a92 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:58.954009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:58.954508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:58.954782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:58.955052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:58.955902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:58.957656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.026442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 895/1792] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:58 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:59.032004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.047336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49dcd4-0237-49d2-8b49-f31417802b6e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.138300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.140554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.140554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.140554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.140912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.142850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.182688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 898/1793] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:59 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:59.184326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.198547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ef4b-20c0-43ba-befd-167644e0d70e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.230857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.232019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.233629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.234568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.235708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.237368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.269574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 896/1794] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:59.274682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.300473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab0817-111e-42a5-9098-bd13d954bdec admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.306836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.307561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.307836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.308104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.308771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.311294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae20e-297e-43b1-b084-85ec370f658b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.329178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 899/1795] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:14:59.334175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.353021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a65e-9c22-4edb-a152-c780b973e557 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.386081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.386755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.387197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.387370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] PATH_INFO: `/v3/projects/c413946b7b314305bede95b986a5b7bd/users/26c4bf64c5dd4cdd99fcc48e86d42077/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.422670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c413946b7b314305bede95b986a5b7bd, user_id=26c4bf64c5dd4cdd99fcc48e86d42077, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.425577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.443556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 897/1796] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:14:59 2022] PUT /identity/v3/projects/c413946b7b314305bede95b986a5b7bd/users/26c4bf64c5dd4cdd99fcc48e86d42077/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:14:59.455977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.456381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.456740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.506595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] MFA Rules not processed for user `26c4bf64c5dd4cdd99fcc48e86d42077`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:14:59.508570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:59.644317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 900/1797] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:14:59.649028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.776547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0171-91db-41f6-b40d-1a7187376967 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.782780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.783419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.783698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.783970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.784624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.786637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.822735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 898/1798] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:14:59 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:14:59.828016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.842087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e624a77-707b-4ff7-8dd4-68b15eab8954 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.901084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:14:59.933291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.934225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.934638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.935044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.935822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.939359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.945864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:14:59.947742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:14:59.963452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2adcf6-08f0-4543-8d1b-c0c0f279130e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:14:59.969433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:14:59.970335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:14:59.970609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:14:59.970884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] PATH_INFO: `/v3/projects/508fee39c87947c593b7d31fe655cc0b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:14:59.972088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=508fee39c87947c593b7d31fe655cc0b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:14:59.974186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:14:59.976018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:00.002994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 901/1799] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:14:59 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:00.004021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.039209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d170-dd79-402b-9ce9-8a7bf1b46fa6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.085338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508fee39c87947c593b7d31fe655cc0b', 'request_id': 'req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:00.096428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508fee39c87947c593b7d31fe655cc0b', 'request_id': 'req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:00.101203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.104830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.105454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.105873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.107246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.110886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.126651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508fee39c87947c593b7d31fe655cc0b', 'request_id': 'req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:00.144714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 902/1800] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:00.150653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.164157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62866f1-7f38-42ef-9ab5-2c58529326e4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.166138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] The token cache is being invalidate because project 508fee39c87947c593b7d31fe655cc0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:00.166589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:00.167437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f8cc97-9ea2-45f4-a13f-7f80de8c7c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:00.174774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 899/1801] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:14:59 2022] DELETE /identity/v3/projects/508fee39c87947c593b7d31fe655cc0b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:00.176682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e9e0-0572-4131-98d3-4b3c74254439 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.177560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e9e0-0572-4131-98d3-4b3c74254439 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.177992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e9e0-0572-4131-98d3-4b3c74254439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.200367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9f41e9e0-0572-4131-98d3-4b3c74254439 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:00.201616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9f41e9e0-0572-4131-98d3-4b3c74254439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:00.269694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 900/1802] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:00.287327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.287623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.287899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.310491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.311527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.311527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.312026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.313034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.314894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.319545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:00.320967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:00.337579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 903/1803] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:00.338097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 901/1804] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:00.338097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.338097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:00.339484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.350986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724af6-57df-4262-aeaf-62c71656a57c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.360296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a95fa-17c0-4051-ad46-167173d22c5c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.365440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.366861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.367225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.367685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] PATH_INFO: `/v3/projects/a3cd62149cc64f75a11ed5bcba5f2819/users/15e9e6b96512462d81c109c49eac31ef/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.372106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.373675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.374025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.374728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.376265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:00.377432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.380658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.411139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 904/1805] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:00.412278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.437110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2fa1e-532e-42bf-bd96-578dd7e8a07f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.449934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cd62149cc64f75a11ed5bcba5f2819, user_id=15e9e6b96512462d81c109c49eac31ef, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.453736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4ba93-a6e0-45db-be2b-3f0857e72a90 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.457239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.457976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.458370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.458685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.459399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.461768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.499623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 902/1806] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:00 2022] PUT /identity/v3/projects/a3cd62149cc64f75a11ed5bcba5f2819/users/15e9e6b96512462d81c109c49eac31ef/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:00.510327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.510573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.510872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.535732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 905/1807] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:00.543249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.555569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] MFA Rules not processed for user `15e9e6b96512462d81c109c49eac31ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:00.556999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:00.627385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f426f6-1960-49b8-9c52-571c825280a9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.630711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:00.633543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.634270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.634546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.634818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.635453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.637412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.652885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 903/1808] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:00.662552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.664394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 906/1809] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:00.668189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.672577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad427-27a8-4c37-8231-198254f4f01b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.676596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:00.678259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.678968 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.679514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.679640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.680366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.681334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aa1fb-2b1c-4699-84b0-c5102e223910 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.682561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.689370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.690094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.691015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.691316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.692196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.693780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.705989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 907/1810] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:00.710551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.722276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb422-25ba-4302-ba4a-5a7b31622109 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.723087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 904/1811] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:00.727462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.814844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.815580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.815903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.816176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.816935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.818943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.824398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3433e62-bb32-4500-a2f2-bd16d783a7cd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.831978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.833088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.833424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.833677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.834574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.837088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 908/1812] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:00.841871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.878923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.895728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f83b7-fea2-41e6-9097-05b11ff9f732 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.897132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 905/1813] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:00 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:00.907939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.910969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.911727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.911957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.912301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] PATH_INFO: `/v3/projects/136eae4f11f44ecdac1ecd2a880ca36d/users/cad88907809844b698b9f70ca7fc1c48/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.943316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cc418-5d72-4e4e-bc9b-ed951e508129 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:00.953082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:00.954627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:00.954909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:00.955245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:00.957176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.958946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.961626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] RBAC: Authorizing `identity:create_grant(project_id=136eae4f11f44ecdac1ecd2a880ca36d, user_id=cad88907809844b698b9f70ca7fc1c48, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:00.970576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd2cd-81d8-432d-85e8-04ff5f5d318a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:00.976789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 906/1814] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:00.981588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:00.999768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eaa7-a2b2-466d-aed6-2160c32c3a66 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.000864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 909/1815] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:00 2022] PUT /identity/v3/projects/136eae4f11f44ecdac1ecd2a880ca36d/users/cad88907809844b698b9f70ca7fc1c48/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:01.008852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.009155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.009427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.054734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] MFA Rules not processed for user `cad88907809844b698b9f70ca7fc1c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:01.056449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:01.109908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.110614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.110871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.111141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] PATH_INFO: `/v3/projects/8c50c238f29c4d60ba007c44529da764/users/f5a27a6a88834b62a53b34ad8574afc1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.131957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c50c238f29c4d60ba007c44529da764, user_id=f5a27a6a88834b62a53b34ad8574afc1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.135038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.152795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 907/1816] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:00 2022] PUT /identity/v3/projects/8c50c238f29c4d60ba007c44529da764/users/f5a27a6a88834b62a53b34ad8574afc1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:01.157776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.164022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 910/1817] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:01.168978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.182976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672e0e2-6973-43d3-abd6-cb954a525181 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.195232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:01.241610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1ffb1-6dd7-4bd0-829e-3e37773207d8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.247336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.248053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.248334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.248720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.249823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.251585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.253473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:01.268718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 908/1818] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:01.268983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.268983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.268983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.268983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.269301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.269830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.270067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.285806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bc171-fb5c-43ec-97f2-9dbbd9af2176 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.290865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.291581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.292031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.292312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] PATH_INFO: `/v3/projects/8c50c238f29c4d60ba007c44529da764/users/f5a27a6a88834b62a53b34ad8574afc1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.297003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c50c238f29c4d60ba007c44529da764, user_id=f5a27a6a88834b62a53b34ad8574afc1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.299033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e25e-1a4b-44a5-9179-9950f6d23ac3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.321949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 911/1819] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:01 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:01.327885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.337400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 909/1820] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:01 2022] PUT /identity/v3/projects/8c50c238f29c4d60ba007c44529da764/users/f5a27a6a88834b62a53b34ad8574afc1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:01.345312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.345610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.345893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.413993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] MFA Rules not processed for user `f5a27a6a88834b62a53b34ad8574afc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:01.416594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:01.431674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835ee38-4d04-4c74-8515-e9c569a463e8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.438743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.440151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.440572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.441047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.441896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.444418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.510401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 912/1821] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:01 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:01.514180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.532460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64167012-5a7b-4f1d-b3c3-f8fd9a256bcf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.548327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129abf9e-0202-4285-b521-03550628575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.549420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abf9e-0202-4285-b521-03550628575e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.549897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abf9e-0202-4285-b521-03550628575e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.550354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129abf9e-0202-4285-b521-03550628575e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.551240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129abf9e-0202-4285-b521-03550628575e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.553047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129abf9e-0202-4285-b521-03550628575e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.564801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 913/1822] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:01.569400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129abf9e-0202-4285-b521-03550628575e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.570618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 910/1823] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:01.583009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129abf9e-0202-4285-b521-03550628575e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.589144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.590696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:01.591463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.592874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.593560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.593982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] PATH_INFO: `/v3/projects/586451ddef9a4620b8a61bd217524e78/users/ebc3e0beddff458f9b3b54b7664fb49c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.623838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=586451ddef9a4620b8a61bd217524e78, user_id=ebc3e0beddff458f9b3b54b7664fb49c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.628353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.652876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 914/1824] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:01 2022] PUT /identity/v3/projects/586451ddef9a4620b8a61bd217524e78/users/ebc3e0beddff458f9b3b54b7664fb49c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:01.659465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.671896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493224-3037-4f54-b5d2-d3372d9c1734 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.764666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.765355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6be37-0406-40d1-ba9e-28e1c3c5a86d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.765488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.766308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.766604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.773506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.774224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.774559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.774892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.775603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.777307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.777439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:01.792599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 915/1825] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:01.798434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:01.811528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939caf6-4361-45c2-b499-0e4cfa6dcb05 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:01.817155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:01.818279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.818675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.818863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] PATH_INFO: `/v3/projects/586451ddef9a4620b8a61bd217524e78/users/ebc3e0beddff458f9b3b54b7664fb49c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.821810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586451ddef9a4620b8a61bd217524e78, user_id=ebc3e0beddff458f9b3b54b7664fb49c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.826026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892488-75e0-40a2-a8b7-4206c78880b9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.841737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 916/1826] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:01 2022] PUT /identity/v3/projects/586451ddef9a4620b8a61bd217524e78/users/ebc3e0beddff458f9b3b54b7664fb49c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:01.854182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff699ff-66b5-4f00-bebe-8e8c96d4b5d9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:01.854457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff699ff-66b5-4f00-bebe-8e8c96d4b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:01.854727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff699ff-66b5-4f00-bebe-8e8c96d4b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:01.859338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:01.860829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:01.871388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 911/1827] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:01.889240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aff699ff-66b5-4f00-bebe-8e8c96d4b5d9 None None] MFA Rules not processed for user `ebc3e0beddff458f9b3b54b7664fb49c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:01.890724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aff699ff-66b5-4f00-bebe-8e8c96d4b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:01.897839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:01.985309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 917/1828] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:02.945699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:02.947730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:02.980661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce1a9f-7955-4b21-ba21-090c789be538 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:03.082437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:03.083223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:03.083822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:03.084119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:03.086609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:03.158432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:03.159886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f1a3-1def-4cce-bb43-7f40da2b2611 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:03.169387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 912/1829] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:04.042564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:04.042965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:04.042965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:04.050467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 918/1830] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:15:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:15:04.088032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:04.088523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:04.088680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:04.147337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:04.147337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:04.251055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:04.276709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 913/1831] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:04.454406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:04.456979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:04.489861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15125f2-3ca7-4a62-b796-1c7f51f3cdf2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:04.497827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:04.499002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:04.499474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:04.499947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:04.513576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:04.515322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:04.535041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 919/1832] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:07.783280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:07.798677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e76d77-55b8-44db-8592-e4b094531669 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:07.803192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:07.803920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:07.804868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:07.805225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:07.891324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:07.895683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:07.926707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:07.928187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa614-985b-43e4-9de6-c9db0e1ce8e0 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:07.940479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 914/1833] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:07.995364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47b1f4-3e39-4dff-8611-2bd3230e6ba3 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:08.004829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:08.005897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:08.008562 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:08.009111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] PATH_INFO: `/v3/users/3e403d5e595d40789407a0796b5ad1a0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:08.012899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e403d5e595d40789407a0796b5ad1a0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:08.015900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:08.099002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e403d5e595d40789407a0796b5ad1a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.100027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e403d5e595d40789407a0796b5ad1a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.116531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e403d5e595d40789407a0796b5ad1a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.126733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e403d5e595d40789407a0796b5ad1a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.127728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e403d5e595d40789407a0796b5ad1a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.153257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 920/1834] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:07 2022] DELETE /identity/v3/users/3e403d5e595d40789407a0796b5ad1a0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:08.161176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:08.162164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:08.162754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:08.188163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:08.189422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:08.255444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 915/1835] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:08.268703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:08.270600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:08.285507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:08.347536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1e68b-f026-4776-aa65-aab4a45a9d61 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:08.351566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:08.352208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:08.352525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:08.352900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:08.363210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:08.364863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:08.376446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 921/1836] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:08.783743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:08.787114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:08.837238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf666e8-a5c3-460e-957e-f00d09af994a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:08.850620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:08.851854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:08.852191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:08.852663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] PATH_INFO: `/v3/projects/bab5d3e81d644336ac5efac6f424129f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:08.854134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab5d3e81d644336ac5efac6f424129f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:08.858215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:08.969656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab5d3e81d644336ac5efac6f424129f', 'request_id': 'req-30941819-ff42-49cf-a71f-0efc6f3001b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:08.997551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab5d3e81d644336ac5efac6f424129f', 'request_id': 'req-30941819-ff42-49cf-a71f-0efc6f3001b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.018508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab5d3e81d644336ac5efac6f424129f', 'request_id': 'req-30941819-ff42-49cf-a71f-0efc6f3001b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.055453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] The token cache is being invalidate because project bab5d3e81d644336ac5efac6f424129f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:09.056304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.057316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.060814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 916/1837] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:08 2022] DELETE /identity/v3/projects/bab5d3e81d644336ac5efac6f424129f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:09.063207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:09.074982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691b2fc-ff13-47f4-b0fb-09eea8c11b2b service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:09.144177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:09.145025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:09.145362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:09.145729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] PATH_INFO: `/v3/users/7e571ab3dff049b4b4bdd46e6679a38b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:09.147093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e571ab3dff049b4b4bdd46e6679a38b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:09.150305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:09.223047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e571ab3dff049b4b4bdd46e6679a38b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.224465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e571ab3dff049b4b4bdd46e6679a38b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.239654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e571ab3dff049b4b4bdd46e6679a38b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.251210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e571ab3dff049b4b4bdd46e6679a38b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.252081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-24cbe426-d953-42de-a259-fd6531403c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e571ab3dff049b4b4bdd46e6679a38b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.288496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 922/1838] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:09 2022] DELETE /identity/v3/users/7e571ab3dff049b4b4bdd46e6679a38b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:09.688558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:09.691062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:09.704649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30941819-ff42-49cf-a71f-0efc6f3001b8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:09.713531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:09.773914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:09.775229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:09.775529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:09.775822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] PATH_INFO: `/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:09.777078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9543cc7c065b43ea9cf56fa65c052fb3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:09.779122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:09.906921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9543cc7c065b43ea9cf56fa65c052fb3', 'request_id': 'req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.918322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9543cc7c065b43ea9cf56fa65c052fb3', 'request_id': 'req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.929966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9543cc7c065b43ea9cf56fa65c052fb3', 'request_id': 'req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.947683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] The token cache is being invalidate because project 9543cc7c065b43ea9cf56fa65c052fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:09.947924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.948566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f62a7bfe-e365-4fc4-88a5-887f21d2afa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:09.953446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 917/1839] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:09 2022] DELETE /identity/v3/projects/9543cc7c065b43ea9cf56fa65c052fb3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:09.955495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:09.955911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:09.956097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:09.994684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:09.995926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.071657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:10.166125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 923/1840] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:10.169479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.169796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.170071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.195209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:10.196561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.206619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 918/1841] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:10.211310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.225073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65752-8c18-4366-8918-b73fbd829d7f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.231429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.232080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.232411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.233155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.234098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:10.234098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.235919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.249801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 924/1842] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:10.254427 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.265457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035bb15-7873-462f-ba87-abac76dc7c83 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.270530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.271247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.271450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.271722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.272370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.274337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.312290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 919/1843] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:10 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:10.313709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.327257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709dc3-0460-4bfa-833e-ace5153f136a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.433409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.434362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.434678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.435366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.436040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.438508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.474178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 925/1844] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:10 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:10.479765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.493903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b6087-10e7-44e8-801a-859101deefd9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.501604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.503522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.503747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.504348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.505684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.509227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.540304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.549295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 920/1845] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:10.558620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2842-3dbe-4954-a3b0-78d06a81169c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.577185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.577989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.578325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.578669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.579433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.581747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14b12-a0fc-4dbe-8ca4-04e1d9cf796b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.597079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 926/1846] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:10.601440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.617070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03b18-6f9a-4071-80a0-7e3d93ef7e0f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:10.627789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:10.629656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.632335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.632335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] PATH_INFO: `/v3/projects/7d52c5e6a4e14b07810ec5393f13d55a/users/0bc11a4f04224c69896bc6336095aef9/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.686628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d52c5e6a4e14b07810ec5393f13d55a, user_id=0bc11a4f04224c69896bc6336095aef9, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:10.690297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:10.728725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 921/1847] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:10 2022] PUT /identity/v3/projects/7d52c5e6a4e14b07810ec5393f13d55a/users/0bc11a4f04224c69896bc6336095aef9/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:10.751080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:10.751580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:10.751949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:10.804867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] MFA Rules not processed for user `0bc11a4f04224c69896bc6336095aef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:10.806652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.893425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.896610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.924836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 927/1848] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:10.927730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:10.930727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:10.998207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:11.012986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:11.049563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2a6ac-7372-47be-a49b-7b015aacb02a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.051933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9360cd-085a-4e87-be8b-4f23b5e935a9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.057661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.057962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.058327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.058434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.058604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.058693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.058876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] PATH_INFO: `/v3/users/26c4bf64c5dd4cdd99fcc48e86d42077` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.058973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.060176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c4bf64c5dd4cdd99fcc48e86d42077)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.060926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.062262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.132524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c4bf64c5dd4cdd99fcc48e86d42077'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:11.153128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c4bf64c5dd4cdd99fcc48e86d42077'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:11.155671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.158203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.170026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 928/1849] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:11.171030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.184618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908b17e-aa61-4e11-a96b-5bd04a246f70 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.185853 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c4bf64c5dd4cdd99fcc48e86d42077'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:11.186671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c4bf64c5dd4cdd99fcc48e86d42077'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:11.187886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cbcc5bb-fbbc-40ec-b301-f17e9e4ad227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c4bf64c5dd4cdd99fcc48e86d42077'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:11.190656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.193914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.193914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.193914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.193914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.194500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.218525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 922/1850] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:10 2022] DELETE /identity/v3/users/26c4bf64c5dd4cdd99fcc48e86d42077 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:11.225013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.225502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.226007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.233702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 929/1851] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:11 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:11.240400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.249965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.270076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:11.271321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.400040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 923/1852] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:11.402060 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0f0b1-24bc-44c8-859f-5c4e06b6eea3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.411244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.412719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.413336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.413957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.414586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.414990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.417700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.419825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.456988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 930/1853] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:11 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:11.459180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.486794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3337665-38cf-4a1a-811f-e2cdb894e2df admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.492400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.493246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.493832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.494164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.494982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.496644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.510045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569003c-d0fd-4a5d-912c-1db5563e8f9d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.516126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.516839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.517127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.517645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.518715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 931/1854] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:11.524106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.536052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.537975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.538497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd8ed7-b53e-46a6-bb61-3853e7327b5f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.545912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.546584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:11.546734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.546933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.547166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] PATH_INFO: `/v3/projects/d90873c92433490d89a011627b294d48/users/82c3b55dd3ae45a48d2308031f7f9321/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.558582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 924/1855] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:11.571913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90873c92433490d89a011627b294d48, user_id=82c3b55dd3ae45a48d2308031f7f9321, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.575186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.595463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 932/1856] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:11 2022] PUT /identity/v3/projects/d90873c92433490d89a011627b294d48/users/82c3b55dd3ae45a48d2308031f7f9321/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:11.600300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.614635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088d96f-ba1d-4e07-8f45-861948de2f12 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.739872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.742393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.759316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:11.770208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.770937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.771334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.771899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.772670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.774543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.792462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 925/1857] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:11.793586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:11.805734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953f5ac-c864-4e5b-91b6-74be50b03b54 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.811826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.812566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.812896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.813164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] PATH_INFO: `/v3/projects/d90873c92433490d89a011627b294d48/users/82c3b55dd3ae45a48d2308031f7f9321/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.815256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90873c92433490d89a011627b294d48, user_id=82c3b55dd3ae45a48d2308031f7f9321, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.832239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05617-544c-4640-8503-4239da990ed3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:11.850504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94a7c-2ca2-4070-a2fe-999731ebb4b1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:11.853444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 926/1858] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:11 2022] PUT /identity/v3/projects/d90873c92433490d89a011627b294d48/users/82c3b55dd3ae45a48d2308031f7f9321/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:11.865739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.866314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.867196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.908303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] MFA Rules not processed for user `82c3b55dd3ae45a48d2308031f7f9321`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:11.911266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:11.968230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc3e0beddff458f9b3b54b7664fb49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586451ddef9a4620b8a61bd217524e78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:11.968230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:11.969109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:11.969645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:11.970431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:11.972381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:11.976213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.008536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 933/1859] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:15:12.010456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.029273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b774e5-9e62-4f61-902e-b02ce46c6890 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.034152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc3e0beddff458f9b3b54b7664fb49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586451ddef9a4620b8a61bd217524e78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.035368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.035801 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.036250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.037236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.041207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.072121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 927/1860] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:12.081478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.083314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.092891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 934/1861] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:12 2022] POST /identity/v3/projects => generated 353 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:12.102411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.247784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b497e-2ccc-48d4-9f5e-5d199fcdf8bd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.276389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383983e-cbee-4278-a34d-61f8f073c864 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.282730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc3e0beddff458f9b3b54b7664fb49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586451ddef9a4620b8a61bd217524e78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.283375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.284329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.284613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.285357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:12.285692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.288479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.290934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.311050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 935/1862] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:12.312414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.342368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.379026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.379668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.380098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.380375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.391500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.491824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a4880-53b7-4f33-a201-ab2cecc786a3 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.498963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.499629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.499903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.500182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] PATH_INFO: `/v3/projects/c413946b7b314305bede95b986a5b7bd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.502645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c413946b7b314305bede95b986a5b7bd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.505260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.511084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.512794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.528479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 928/1863] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:12.529727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.562991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f3b7-ec15-44cd-ae02-15945c298a3a service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.573570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebc3e0beddff458f9b3b54b7664fb49c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '586451ddef9a4620b8a61bd217524e78', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.575088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.575352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.575784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] PATH_INFO: `/v3/projects/a8b41acb2f464a29961269fb6196f129` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.577922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a8b41acb2f464a29961269fb6196f129)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.583079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.624835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c413946b7b314305bede95b986a5b7bd', 'request_id': 'req-96c702d4-1adb-4a2f-8056-9d697c01db05'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.634213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c413946b7b314305bede95b986a5b7bd', 'request_id': 'req-96c702d4-1adb-4a2f-8056-9d697c01db05'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.644645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c413946b7b314305bede95b986a5b7bd', 'request_id': 'req-96c702d4-1adb-4a2f-8056-9d697c01db05'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.667649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b41acb2f464a29961269fb6196f129', 'request_id': 'req-17c21179-72f0-423c-8eaa-3aecc28cc600'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.683722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] The token cache is being invalidate because project c413946b7b314305bede95b986a5b7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:12.684034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.685182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.689963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 936/1864] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:12 2022] DELETE /identity/v3/projects/c413946b7b314305bede95b986a5b7bd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:12.696194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.698685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.709090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b41acb2f464a29961269fb6196f129', 'request_id': 'req-17c21179-72f0-423c-8eaa-3aecc28cc600'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.721301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b41acb2f464a29961269fb6196f129', 'request_id': 'req-17c21179-72f0-423c-8eaa-3aecc28cc600'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.741339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] The token cache is being invalidate because project a8b41acb2f464a29961269fb6196f129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:12.741743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.742395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:12.749066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 929/1865] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:12 2022] DELETE /identity/v3/projects/a8b41acb2f464a29961269fb6196f129 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:12.750416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:12.752569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.843785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c702d4-1adb-4a2f-8056-9d697c01db05 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.876250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21179-72f0-423c-8eaa-3aecc28cc600 tempest-VolumeQuotaClassesTest-558460519 tempest-VolumeQuotaClassesTest-558460519-project-admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:12.880716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.881369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.881646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.882070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.886151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:12.908313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.960618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:12.961264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:12.961537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:12.961970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] PATH_INFO: `/v3/users/15e9e6b96512462d81c109c49eac31ef` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:12.963213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e9e6b96512462d81c109c49eac31ef)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.965388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:12.968984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:12.995555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:12.997450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:13.014196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 930/1866] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:13.098873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e9e6b96512462d81c109c49eac31ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.099991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e9e6b96512462d81c109c49eac31ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.126774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e9e6b96512462d81c109c49eac31ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.136621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e9e6b96512462d81c109c49eac31ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.137445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-10eb8f6a-8a89-4c8c-aadd-f23223c08d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e9e6b96512462d81c109c49eac31ef'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.163780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 937/1867] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:12 2022] DELETE /identity/v3/users/15e9e6b96512462d81c109c49eac31ef => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:13.326061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:13.328547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.347990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98055008-5c86-4c18-a430-e1441eee4149 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:13.425218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:13.425961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:13.426242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:13.426518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] PATH_INFO: `/v3/users/cad88907809844b698b9f70ca7fc1c48` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:13.427814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad88907809844b698b9f70ca7fc1c48)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:13.430071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:13.508865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad88907809844b698b9f70ca7fc1c48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.518247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad88907809844b698b9f70ca7fc1c48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.536661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad88907809844b698b9f70ca7fc1c48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.538362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad88907809844b698b9f70ca7fc1c48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.538637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad88907809844b698b9f70ca7fc1c48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.555270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 931/1868] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:13 2022] DELETE /identity/v3/users/cad88907809844b698b9f70ca7fc1c48 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:13.559922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a946-36cd-400a-b751-9639299bc947 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:13.560406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a946-36cd-400a-b751-9639299bc947 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:13.560664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a946-36cd-400a-b751-9639299bc947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:13.577949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:13.580008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.586253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d954a946-36cd-400a-b751-9639299bc947 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:13.587529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d954a946-36cd-400a-b751-9639299bc947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.629430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:13.672811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 938/1869] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:13.683717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a946-36cd-400a-b751-9639299bc947 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:13.687239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069acd9-5c7f-4efb-a4cd-0e14ddb421d5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:13.689670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d954a946-36cd-400a-b751-9639299bc947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.696339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:13.697242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:13.697641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:13.697932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] PATH_INFO: `/v3/projects/a3cd62149cc64f75a11ed5bcba5f2819` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:13.699243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cd62149cc64f75a11ed5bcba5f2819)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:13.701642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:13.774092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a946-36cd-400a-b751-9639299bc947 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:13.791341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cd62149cc64f75a11ed5bcba5f2819', 'request_id': 'req-61f79264-1c81-450b-a675-b15e11f7e0af'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.808314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cd62149cc64f75a11ed5bcba5f2819', 'request_id': 'req-61f79264-1c81-450b-a675-b15e11f7e0af'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.824481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cd62149cc64f75a11ed5bcba5f2819', 'request_id': 'req-61f79264-1c81-450b-a675-b15e11f7e0af'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.861927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:13.867969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] The token cache is being invalidate because project a3cd62149cc64f75a11ed5bcba5f2819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:13.868260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.869173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:13.871230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 932/1870] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:13 2022] DELETE /identity/v3/projects/a3cd62149cc64f75a11ed5bcba5f2819 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:13.876154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:13.878563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.887154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:13.888153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:13.888153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:13.888505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:13.891058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:13.972371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79264-1c81-450b-a675-b15e11f7e0af admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:13.978412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:13.979408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:13.979886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:13.980352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] PATH_INFO: `/v3/users/f5a27a6a88834b62a53b34ad8574afc1` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:13.989536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a27a6a88834b62a53b34ad8574afc1)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:13.992953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:13.995058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:13.996655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:14.012502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 939/1871] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:14.091204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a27a6a88834b62a53b34ad8574afc1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.109113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a27a6a88834b62a53b34ad8574afc1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.120889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:14.152570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a27a6a88834b62a53b34ad8574afc1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.153440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a27a6a88834b62a53b34ad8574afc1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.154148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a27a6a88834b62a53b34ad8574afc1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.185512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 933/1872] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:13 2022] DELETE /identity/v3/users/f5a27a6a88834b62a53b34ad8574afc1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:14.687021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:14.690234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:14.713662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d9c21-c37e-415b-84f0-78db4422bb6c service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:14.839546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:14.840383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:14.840655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:14.841030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] PATH_INFO: `/v3/projects/136eae4f11f44ecdac1ecd2a880ca36d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:14.843485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136eae4f11f44ecdac1ecd2a880ca36d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:14.846704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:14.941391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136eae4f11f44ecdac1ecd2a880ca36d', 'request_id': 'req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.953108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136eae4f11f44ecdac1ecd2a880ca36d', 'request_id': 'req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.963036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136eae4f11f44ecdac1ecd2a880ca36d', 'request_id': 'req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.989607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] The token cache is being invalidate because project 136eae4f11f44ecdac1ecd2a880ca36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:14.990225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.991229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:14.993868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 940/1873] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:14 2022] DELETE /identity/v3/projects/136eae4f11f44ecdac1ecd2a880ca36d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:14.999260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:15.002266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.024196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e43e3b-7abe-4c25-a03a-84059a71e9fb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:15.146493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:15.147354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.147632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.148029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] PATH_INFO: `/v3/users/ebc3e0beddff458f9b3b54b7664fb49c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.149487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc3e0beddff458f9b3b54b7664fb49c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:15.152636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:15.267623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc3e0beddff458f9b3b54b7664fb49c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.309372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc3e0beddff458f9b3b54b7664fb49c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.344356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc3e0beddff458f9b3b54b7664fb49c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.345503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc3e0beddff458f9b3b54b7664fb49c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.346293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b3f384ba-1031-4ff3-966b-f11f544553e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc3e0beddff458f9b3b54b7664fb49c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.351739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:15.354305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.385881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 934/1874] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:14 2022] DELETE /identity/v3/users/ebc3e0beddff458f9b3b54b7664fb49c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:15.401870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c5d57-6a0a-4054-8ccf-b4a3ecb027c8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:15.419744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:15.542855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:15.543849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.544202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.544875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] PATH_INFO: `/v3/projects/8c50c238f29c4d60ba007c44529da764` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.546616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c50c238f29c4d60ba007c44529da764)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:15.549309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:15.618011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c50c238f29c4d60ba007c44529da764', 'request_id': 'req-601a3f51-4d91-4945-a481-a135bd7eff5f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.630669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c50c238f29c4d60ba007c44529da764', 'request_id': 'req-601a3f51-4d91-4945-a481-a135bd7eff5f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.638645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c50c238f29c4d60ba007c44529da764', 'request_id': 'req-601a3f51-4d91-4945-a481-a135bd7eff5f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.657093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] The token cache is being invalidate because project 8c50c238f29c4d60ba007c44529da764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:15.660872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.661959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.667156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 941/1875] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:15 2022] DELETE /identity/v3/projects/8c50c238f29c4d60ba007c44529da764 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:15.673176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f66c-8c61-4085-9618-43a022addd87 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.673684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f66c-8c61-4085-9618-43a022addd87 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.674024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f66c-8c61-4085-9618-43a022addd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.720250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7fe3f66c-8c61-4085-9618-43a022addd87 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:15.721518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7fe3f66c-8c61-4085-9618-43a022addd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.796189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:15.821034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 935/1876] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:15.825154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:15.833414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.833976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.834315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.834646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.853709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a3f51-4d91-4945-a481-a135bd7eff5f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:15.856774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:15.858634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:15.861818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:15.862564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.863232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.863232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] PATH_INFO: `/v3/projects/586451ddef9a4620b8a61bd217524e78` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.864452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586451ddef9a4620b8a61bd217524e78)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:15.866636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:15.869896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 936/1877] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:15.875315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:15.888649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35aff55-be20-4401-989b-28d17b4776c5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:15.893798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:15.894694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.895088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.895429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:15.896211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:15.896606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:15.898681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:15.914201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 937/1878] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:15.918794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:15.930905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64264d-ea21-4cae-be7e-d3501e258f59 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:15.933665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586451ddef9a4620b8a61bd217524e78', 'request_id': 'req-f7e9b566-d5f4-486c-97fb-d0d6e6595923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.941034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586451ddef9a4620b8a61bd217524e78', 'request_id': 'req-f7e9b566-d5f4-486c-97fb-d0d6e6595923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.949571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586451ddef9a4620b8a61bd217524e78', 'request_id': 'req-f7e9b566-d5f4-486c-97fb-d0d6e6595923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.967416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] The token cache is being invalidate because project 586451ddef9a4620b8a61bd217524e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:15.967726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.968368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f7e9b566-d5f4-486c-97fb-d0d6e6595923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:15.970190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 942/1879] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:15 2022] DELETE /identity/v3/projects/586451ddef9a4620b8a61bd217524e78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:15.976569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830429d-af39-42b4-a50f-e047df328c66 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:15.976969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830429d-af39-42b4-a50f-e047df328c66 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:15.977187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830429d-af39-42b4-a50f-e047df328c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.000346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.001000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.001286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.001560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.002211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.004145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.005594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a830429d-af39-42b4-a50f-e047df328c66 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:16.007471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a830429d-af39-42b4-a50f-e047df328c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.020818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 943/1880] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:16.025412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.025685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.025948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.036950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 938/1881] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:15 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:16.041227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.043022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.046832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:16.047937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.070278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.139819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 944/1882] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:16.142758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e284a-a759-4f21-82f5-8145a9906e95 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.144655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.148431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.149070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.149352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.149649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.150288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.152385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.155478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ce18-d860-4998-90d7-262ef45e7c78 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.162669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.164103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.164436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.165184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.166375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:16.167443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.169114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.187970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 939/1883] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:16.188196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 945/1884] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:16.194323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.204534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.206130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a29f00-673f-430f-9506-b7de88dd7cf9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.211477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.212113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.212816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.212816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.213479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.215420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.228834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc08e3-7203-4110-8d6a-47d7d34ea70c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.235887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.236673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.236988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.237316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.238056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.240597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.269608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 940/1885] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:16.274312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.279615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 946/1886] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:16.281727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.289248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a572f-2bda-46da-a955-17e3e4888220 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.376008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.394432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3bbf-f35f-4dac-9555-d73e2ede7d97 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.400500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.401174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.401924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.402227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.403297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.406771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.418145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.419250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.419753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.420307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.421341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.424166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.448379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 947/1887] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:16.448572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 941/1888] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:16.452285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.460242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.483042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef574-1a22-4989-926e-9356667b33c2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.484009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890239b6-265a-4d10-8e08-59476b779781 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.502948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.502948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.502948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.502948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.504520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.507144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.524521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.528845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.529856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.531437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] PATH_INFO: `/v3/projects/2c418b515d2f4fdda95222531509e912/users/368eb08d62dc4e87a6c0a82b150ef0d5/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.535785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 948/1889] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:16.541972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.569079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c418b515d2f4fdda95222531509e912, user_id=368eb08d62dc4e87a6c0a82b150ef0d5, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.571873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.590336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3974a-8b75-43f7-9139-f3e1747069ba admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.601910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.602608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.602950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.603309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.604031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.614941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8244a59-9142-4579-8c46-0041826775cb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.616431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 942/1890] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:16 2022] PUT /identity/v3/projects/2c418b515d2f4fdda95222531509e912/users/368eb08d62dc4e87a6c0a82b150ef0d5/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:16.622175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.624674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.626984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 949/1891] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:16.634845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.635209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.635576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.690754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] MFA Rules not processed for user `368eb08d62dc4e87a6c0a82b150ef0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:16.692006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.751960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:16.767256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c448a-908c-472e-92eb-5be8e40777d9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.772768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.773454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.773738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.774017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] PATH_INFO: `/v3/users/0bc11a4f04224c69896bc6336095aef9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.775449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc11a4f04224c69896bc6336095aef9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.777616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.795903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 950/1892] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:16.795903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.824184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715615ea-464a-4ead-b941-6374542d8af8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:16.832665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:16.834056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.834386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.834760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] PATH_INFO: `/v3/projects/c7c772d98024467a89ad18764395b087/users/e1160ee202844fa0b9807c43f057e849/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.860202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc11a4f04224c69896bc6336095aef9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:16.863370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c772d98024467a89ad18764395b087, user_id=e1160ee202844fa0b9807c43f057e849, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:16.877062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc11a4f04224c69896bc6336095aef9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:16.878197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:16.897337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc11a4f04224c69896bc6336095aef9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:16.899589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc11a4f04224c69896bc6336095aef9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:16.900720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c861a97a-c125-4b59-8aa9-fb39d31a5979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc11a4f04224c69896bc6336095aef9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:16.902655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 951/1893] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:16 2022] PUT /identity/v3/projects/c7c772d98024467a89ad18764395b087/users/e1160ee202844fa0b9807c43f057e849/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:16.903577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:16.905756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:16.939838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 943/1894] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:16 2022] DELETE /identity/v3/users/0bc11a4f04224c69896bc6336095aef9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:16.941862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719416f-32a4-46ab-b400-13f61bf880af None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:16.942239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719416f-32a4-46ab-b400-13f61bf880af None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:16.942516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719416f-32a4-46ab-b400-13f61bf880af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:16.988025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0719416f-32a4-46ab-b400-13f61bf880af None None] MFA Rules not processed for user `e1160ee202844fa0b9807c43f057e849`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:16.989974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0719416f-32a4-46ab-b400-13f61bf880af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:17.012050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd50ea1-646e-4946-b17f-84e246e880d4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.031064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:17.117061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 944/1895] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:17.119191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.119630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.120052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.126929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.127567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.127893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.128164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.128827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.135608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.144264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:17.145710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:17.158828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 945/1896] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:17.160044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.161463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:17.189480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a61b8d-25b4-4118-8540-2cb7388625d7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.190685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 952/1897] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:16 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:17.194322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.197414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:17.306964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.307736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.309907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.310168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.310887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.313565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.319369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1b0e-4b96-46d3-a7c8-b195182bd187 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.323968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.325267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.325537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.325810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.342399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:17.349216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.351650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.362740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 946/1898] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:17 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:17.366616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 953/1899] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:17.367989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.369309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.381207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc070f-7b98-4b94-8644-e7617ef1a70f service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.485843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c65c0-966a-4c3a-82d9-87202b94655b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.490605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.492099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.492274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.492641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.492900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.493159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.493285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.493432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.494083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.496085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.496601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.500802 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.547342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 954/1900] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:17 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:17.551942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.563633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 947/1901] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:17 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:17.567043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.575313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ae90-23a1-47f5-a3c0-30db1cea89dc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.583149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ac66a-2ffd-487a-b67e-6132059e4958 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.585343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.586050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.586330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.586591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.587711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.589011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.589643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.590676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.590959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.591320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.592124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.593860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.612849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 948/1902] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:17.613499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 955/1903] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:17.614308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.616928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.629295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6331-f7e1-4e38-9e28-cc9da5aed893 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.644582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de02e-ffea-4b25-8fb1-8dcec8ae6f36 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.654633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.656648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.656981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.657255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] PATH_INFO: `/v3/projects/b7302cbef58042f18a3aae6df65d47e2/users/ae56fec2c0d54ed29dbda91d8ebe2151/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.669845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.670886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.671261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.671571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] PATH_INFO: `/v3/projects/1f18c926e63f4b228196c83d1147357b/users/de16dd0128e1455c84482ca5328ee6cd/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.717813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f18c926e63f4b228196c83d1147357b, user_id=de16dd0128e1455c84482ca5328ee6cd, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.721535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.738094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7302cbef58042f18a3aae6df65d47e2, user_id=ae56fec2c0d54ed29dbda91d8ebe2151, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.744012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.754111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:17.776588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 956/1905] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:17 2022] PUT /identity/v3/projects/b7302cbef58042f18a3aae6df65d47e2/users/ae56fec2c0d54ed29dbda91d8ebe2151/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:17.779497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.781917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 949/1905] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:17 2022] PUT /identity/v3/projects/1f18c926e63f4b228196c83d1147357b/users/de16dd0128e1455c84482ca5328ee6cd/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:17.784892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.922383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec59920-37dc-4773-b07e-2cc98d553e42 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.930333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef61c0-179f-42b7-bc99-5095765238db admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.934854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.935601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.936159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.936491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.937531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.939174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.939313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.939967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.940390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.940667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.941375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.943193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:17.953504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 957/1906] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:17.959284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.965834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 950/1907] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:17.971474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:17.976987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545c14-5b68-4aba-bcf3-249334cd0dfe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.986809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4a4d-d559-4629-b575-629a7d0aab2d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:17.991695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.993029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:17.994412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.994690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.994959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] PATH_INFO: `/v3/projects/b7302cbef58042f18a3aae6df65d47e2/users/ae56fec2c0d54ed29dbda91d8ebe2151/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.996978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7302cbef58042f18a3aae6df65d47e2, user_id=ae56fec2c0d54ed29dbda91d8ebe2151, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:17.997398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:17.999197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:17.999694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] PATH_INFO: `/v3/projects/1f18c926e63f4b228196c83d1147357b/users/de16dd0128e1455c84482ca5328ee6cd/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:17.999799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609042dc-0c6e-4c6f-a8e5-2d41a61549bb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.002123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f18c926e63f4b228196c83d1147357b, user_id=de16dd0128e1455c84482ca5328ee6cd, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:18.005165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364e2e-97c0-4b97-b823-2ecdc6bbf8de admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.013411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 951/1908] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:17 2022] PUT /identity/v3/projects/b7302cbef58042f18a3aae6df65d47e2/users/ae56fec2c0d54ed29dbda91d8ebe2151/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:18.019076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 958/1909] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:17 2022] PUT /identity/v3/projects/1f18c926e63f4b228196c83d1147357b/users/de16dd0128e1455c84482ca5328ee6cd/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:18.026782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.027438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.027775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.034387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.035620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.035906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.077072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] MFA Rules not processed for user `ae56fec2c0d54ed29dbda91d8ebe2151`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:18.078565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.083168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] MFA Rules not processed for user `de16dd0128e1455c84482ca5328ee6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:18.085256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.120934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:18.205557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 952/1910] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:18.221458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 959/1911] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:18.227290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.230090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.235248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.236887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.333725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f1bce-a087-4c04-a5ee-1791aeaabbad None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:18.338697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76034-ee90-4043-9a32-ae88097345fd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:18.338932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:18.339505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.339823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.340142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.345837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:18.346899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.347453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.347937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.354095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:18.355642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.367749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:18.369622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 953/1912] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:18.369826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.393265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 960/1913] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:18.490305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.491947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.519876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:18.626226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc79db6-2ea4-4dfd-924c-6dc2ff50fb6d service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:18.635190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:18.636210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.637229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.637229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] PATH_INFO: `/v3/projects/7d52c5e6a4e14b07810ec5393f13d55a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.640118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d52c5e6a4e14b07810ec5393f13d55a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:18.644727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.667093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.693837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabc092-9b37-44e8-afe6-d0302b0e946e service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:18.713462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:18.714124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:18.715702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:18.716132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:18.721645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.761092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d52c5e6a4e14b07810ec5393f13d55a', 'request_id': 'req-798945de-6e3f-4814-a3e5-f9c658a4cb4a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:18.776283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d52c5e6a4e14b07810ec5393f13d55a', 'request_id': 'req-798945de-6e3f-4814-a3e5-f9c658a4cb4a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:18.790532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d52c5e6a4e14b07810ec5393f13d55a', 'request_id': 'req-798945de-6e3f-4814-a3e5-f9c658a4cb4a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:18.819487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] The token cache is being invalidate because project 7d52c5e6a4e14b07810ec5393f13d55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:18.820165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:18.821681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:18.831882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 954/1914] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:18 2022] DELETE /identity/v3/projects/7d52c5e6a4e14b07810ec5393f13d55a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:18.836699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.839335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:18.898888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:18.900435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:18.913240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 961/1915] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:18.917108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:18.936351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d35-6c1e-47d9-a422-02c1df1572b1 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:19.005166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798945de-6e3f-4814-a3e5-f9c658a4cb4a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:19.013435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:19.015068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.015539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.015994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] PATH_INFO: `/v3/users/82c3b55dd3ae45a48d2308031f7f9321` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.021111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c3b55dd3ae45a48d2308031f7f9321)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:19.023451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:19.060415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:19.061573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.062223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.063079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] PATH_INFO: `/v3/users/e1160ee202844fa0b9807c43f057e849` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.066312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1160ee202844fa0b9807c43f057e849)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:19.070393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:19.073998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:19.099707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:19.113512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c3b55dd3ae45a48d2308031f7f9321'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.129940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c3b55dd3ae45a48d2308031f7f9321'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.148229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c3b55dd3ae45a48d2308031f7f9321'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.149421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c3b55dd3ae45a48d2308031f7f9321'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.150445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3de84eb-63cb-4feb-847c-15a7fe25fdd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c3b55dd3ae45a48d2308031f7f9321'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.161777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1160ee202844fa0b9807c43f057e849'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.162869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1160ee202844fa0b9807c43f057e849'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.170588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 955/1916] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:18 2022] DELETE /identity/v3/users/82c3b55dd3ae45a48d2308031f7f9321 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:19.173173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1160ee202844fa0b9807c43f057e849'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.184046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1160ee202844fa0b9807c43f057e849'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.184507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1160ee202844fa0b9807c43f057e849'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.219323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 962/1917] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:18 2022] DELETE /identity/v3/users/e1160ee202844fa0b9807c43f057e849 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:19.224308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.224587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.224916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.266755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:19.268654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:19.368845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 956/1918] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:19.379736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:19.381285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:19.501257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca20c21-b74e-4621-ba7b-365ebc9cfb0b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:19.505197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:19.505829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.506097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.506359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.519099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:19.520530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fe511-cb73-488e-8951-75a60d31c2af service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:19.532005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 963/1919] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:19.703653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:19.705252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:19.721373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f92a4-99f6-435e-8a36-4572a4b7761a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:19.727630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:19.728655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.728976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.729245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] PATH_INFO: `/v3/projects/d90873c92433490d89a011627b294d48` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.731012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90873c92433490d89a011627b294d48)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:19.733651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:19.798059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90873c92433490d89a011627b294d48', 'request_id': 'req-3369d91e-f82f-4c47-8e29-939a5c7c7496'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.806080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90873c92433490d89a011627b294d48', 'request_id': 'req-3369d91e-f82f-4c47-8e29-939a5c7c7496'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.813168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90873c92433490d89a011627b294d48', 'request_id': 'req-3369d91e-f82f-4c47-8e29-939a5c7c7496'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.831180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] The token cache is being invalidate because project d90873c92433490d89a011627b294d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:19.831819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.832661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:19.838651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 957/1920] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:19 2022] DELETE /identity/v3/projects/d90873c92433490d89a011627b294d48 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:19.845813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d1b-80aa-4d2b-a6b6-62c56654fd8a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:19.846089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d1b-80aa-4d2b-a6b6-62c56654fd8a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:19.846363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a6d1b-80aa-4d2b-a6b6-62c56654fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:19.874897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c82a6d1b-80aa-4d2b-a6b6-62c56654fd8a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:19.876162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c82a6d1b-80aa-4d2b-a6b6-62c56654fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:19.951346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:19.957577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.007543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 964/1921] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:20.017340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.017691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.018093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.035778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.053190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:20.054555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.077165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 965/1922] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:20.078785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.085462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d91e-f82f-4c47-8e29-939a5c7c7496 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.092973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.093908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.094195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.094470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] PATH_INFO: `/v3/projects/c7c772d98024467a89ad18764395b087` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.095091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e645-e022-4015-b391-748a5cb5efe4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.096486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c772d98024467a89ad18764395b087)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.099169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.101730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.102556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.102970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.103432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.105022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:20.105769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.108309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.125601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 966/1923] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:20.133027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.140376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.149145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813580c-8888-43dc-b2df-528d9a51526d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.159374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.160299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.160614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.160866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.161619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.164725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.188662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c772d98024467a89ad18764395b087', 'request_id': 'req-fff7750b-2310-421d-a7ae-fe217c140610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.196184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c772d98024467a89ad18764395b087', 'request_id': 'req-fff7750b-2310-421d-a7ae-fe217c140610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.199357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 967/1924] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:20.204729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.205061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c772d98024467a89ad18764395b087', 'request_id': 'req-fff7750b-2310-421d-a7ae-fe217c140610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.219327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] The token cache is being invalidate because project c7c772d98024467a89ad18764395b087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:20.219858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.220486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.222001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 958/1925] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:19 2022] DELETE /identity/v3/projects/c7c772d98024467a89ad18764395b087 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:20.226457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.227861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.281414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b334-0ac6-4293-b719-bccaacb03cc9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.286362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.286989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.287273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.287543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.288185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.290205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.303698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7750b-2310-421d-a7ae-fe217c140610 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.310324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.311020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.311291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.311756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] PATH_INFO: `/v3/users/ae56fec2c0d54ed29dbda91d8ebe2151` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.313040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae56fec2c0d54ed29dbda91d8ebe2151)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.315210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.317900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 968/1926] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:20.324833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.327572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.347426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771601db-715a-483b-8591-2ee6f801f976 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.354366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.355312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.355739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.356175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.357260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.360251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.375766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 969/1927] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:20.384343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.395081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290dc80-68af-480b-b8fb-cb1adbea999d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.400188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.400847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.401123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.401386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.402047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.403647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.408294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae56fec2c0d54ed29dbda91d8ebe2151'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.416649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 970/1928] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:20.420279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae56fec2c0d54ed29dbda91d8ebe2151'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.421763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.435051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260671a-3c2d-4bd3-8617-00e5e62488bd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.436434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae56fec2c0d54ed29dbda91d8ebe2151'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.437342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae56fec2c0d54ed29dbda91d8ebe2151'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.438121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d904b950-c5be-4afc-92f6-9ba7d0ebfe52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae56fec2c0d54ed29dbda91d8ebe2151'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:20.440201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:20.441134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.441827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.442158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.442795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] PATH_INFO: `/v3/projects/fd2fed4f971f417aa0284b3f454856df/users/43ea73b6c0a14099a3c8d67cf1a72573/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.456133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 959/1929] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:20 2022] DELETE /identity/v3/users/ae56fec2c0d54ed29dbda91d8ebe2151 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:20.465638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2fed4f971f417aa0284b3f454856df, user_id=43ea73b6c0a14099a3c8d67cf1a72573, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.468650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.489320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 971/1930] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:20 2022] PUT /identity/v3/projects/fd2fed4f971f417aa0284b3f454856df/users/43ea73b6c0a14099a3c8d67cf1a72573/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:20.501957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.503245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.503729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.560283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] MFA Rules not processed for user `43ea73b6c0a14099a3c8d67cf1a72573`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:20.561766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.656336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 960/1931] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:20.661196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.665863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:20.791676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ec27-f4aa-4c88-9c21-639275816d65 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.803217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.805361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.805361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.805824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.806562 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.808699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.860988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 972/1932] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:20.863016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.883568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beabc2a-2097-485e-a30b-6fe9a0fc2973 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:20.985795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:20.987038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:20.987510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:20.988022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:20.989034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:20.989846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:20.992125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:20.992661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.009651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f460-9163-41d6-80fa-c3793b2f468c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.020074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.021296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.022060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 961/1933] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:20 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:21.027577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.029537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.029718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] PATH_INFO: `/v3/projects/b7302cbef58042f18a3aae6df65d47e2` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.031197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7302cbef58042f18a3aae6df65d47e2)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.033595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.036821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:21.038695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ede7-4b95-4344-89b6-f80852232b7f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.043699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aa7be-c726-4652-b794-96422741895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.044962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa7be-c726-4652-b794-96422741895f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.044962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa7be-c726-4652-b794-96422741895f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.044962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa7be-c726-4652-b794-96422741895f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.045982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883aa7be-c726-4652-b794-96422741895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.047645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883aa7be-c726-4652-b794-96422741895f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.061425 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 962/1934] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:21.065782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aa7be-c726-4652-b794-96422741895f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.078379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aa7be-c726-4652-b794-96422741895f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.093552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.095641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.095641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.095641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] PATH_INFO: `/v3/projects/32150a43ee7748f095d8b15833efed96/users/9e9afd1d5a654c7db631e1ca555a9490/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.115768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7302cbef58042f18a3aae6df65d47e2', 'request_id': 'req-019b7a02-0878-4471-b250-6b925cc1c1af'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:21.121628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32150a43ee7748f095d8b15833efed96, user_id=9e9afd1d5a654c7db631e1ca555a9490, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.125265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.129612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7302cbef58042f18a3aae6df65d47e2', 'request_id': 'req-019b7a02-0878-4471-b250-6b925cc1c1af'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:21.160814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 963/1935] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:21 2022] PUT /identity/v3/projects/32150a43ee7748f095d8b15833efed96/users/9e9afd1d5a654c7db631e1ca555a9490/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:21.163761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7302cbef58042f18a3aae6df65d47e2', 'request_id': 'req-019b7a02-0878-4471-b250-6b925cc1c1af'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:21.166836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.187075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] The token cache is being invalidate because project b7302cbef58042f18a3aae6df65d47e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:21.187290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:21.188108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019b7a02-0878-4471-b250-6b925cc1c1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:21.190437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 973/1936] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:20 2022] DELETE /identity/v3/projects/b7302cbef58042f18a3aae6df65d47e2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:21.197016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bf469-427f-4db7-af56-05c545cc0291 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.197607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bf469-427f-4db7-af56-05c545cc0291 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.197954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bf469-427f-4db7-af56-05c545cc0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.226463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c83bf469-427f-4db7-af56-05c545cc0291 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:21.229745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c83bf469-427f-4db7-af56-05c545cc0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.291181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:21.351293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a992-236a-40a3-9f14-fd27933a007d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.356940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 974/1937] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:21.361669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.362565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.363045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.363549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.364651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.366692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.367351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.367805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.369953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.396006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 964/1938] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:21.403884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.408792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:21.410704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.411001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.425988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 975/1939] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:21.432861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.436335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647feb6-d94a-41cd-ae46-1a1a4944cce3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.447139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.448309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.448839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.449317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] PATH_INFO: `/v3/projects/32150a43ee7748f095d8b15833efed96/users/9e9afd1d5a654c7db631e1ca555a9490/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.454728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32150a43ee7748f095d8b15833efed96, user_id=9e9afd1d5a654c7db631e1ca555a9490, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.460589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754a6d0-62af-48df-8468-d10fea7d9124 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.465440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352c83-4e2d-429e-a625-40a6a893331b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.474512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.475239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.475511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.475773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.477949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:21.478494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.480840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 965/1940] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:21 2022] PUT /identity/v3/projects/32150a43ee7748f095d8b15833efed96/users/9e9afd1d5a654c7db631e1ca555a9490/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:21.481744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.495046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.495336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.495608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.518217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 976/1941] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:21.522770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.531894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] MFA Rules not processed for user `9e9afd1d5a654c7db631e1ca555a9490`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:21.533185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.534034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098f0f-4527-4d7d-84f8-a756e6ba04c0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.602516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.603565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.604064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.604512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.605644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.609474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.630251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 966/1942] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:21.640923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.641118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:21.642941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.652609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 977/1943] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/projects => generated 359 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:21.661800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.739273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a1000-4c7d-4201-b33d-5558c8ba1a09 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.778886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d620d-4789-46c2-a0c9-d6d58a31a8de admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.790672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.791742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.792239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.792712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.794523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.798373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.836164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 978/1944] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:21 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:21.840006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.855568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.855848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788336a-1e72-41a5-b714-681a6c77df55 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.855985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.856279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.856535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.862309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.863081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.863483 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.863849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.864640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.866434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.871363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:21.883825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 979/1945] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:21.885104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.896554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1fcf3-1379-4ecd-a3a1-6916d0c14fe0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.902984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.904446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.904586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.905288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.905997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.907900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.921348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 980/1946] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:21.926791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.937813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35645ff0-e924-4a87-a31d-9fe84348ebce admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.948795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.948795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.948795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.948795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] PATH_INFO: `/v3/projects/1b9d6987a3a548be8766c5fc94e5de65/users/7ddf81400e9f40238038f92da7b964b7/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:21.951922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.953430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.967731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 967/1947] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:21.968833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:21.970448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:21.980541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9d6987a3a548be8766c5fc94e5de65, user_id=7ddf81400e9f40238038f92da7b964b7, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:21.984391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ab85f-6958-469c-9f8b-2ef4b906ffef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:21.987560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b1be3-49f4-434b-92ab-3a5190cc2b15 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:21.993004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:21.993741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:21.994020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:21.994390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] PATH_INFO: `/v3/users/368eb08d62dc4e87a6c0a82b150ef0d5` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.007480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368eb08d62dc4e87a6c0a82b150ef0d5)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.007480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.007657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 981/1948] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:21 2022] PUT /identity/v3/projects/1b9d6987a3a548be8766c5fc94e5de65/users/7ddf81400e9f40238038f92da7b964b7/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:22.017484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470c2a-0892-49c3-8262-6f52cee0ea28 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.018225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470c2a-0892-49c3-8262-6f52cee0ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.018225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29470c2a-0892-49c3-8262-6f52cee0ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.057826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-29470c2a-0892-49c3-8262-6f52cee0ea28 None None] MFA Rules not processed for user `7ddf81400e9f40238038f92da7b964b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:22.059104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-29470c2a-0892-49c3-8262-6f52cee0ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.072460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368eb08d62dc4e87a6c0a82b150ef0d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.080679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368eb08d62dc4e87a6c0a82b150ef0d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.095291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368eb08d62dc4e87a6c0a82b150ef0d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.096056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368eb08d62dc4e87a6c0a82b150ef0d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.096710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368eb08d62dc4e87a6c0a82b150ef0d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.115121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 968/1949] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:21 2022] DELETE /identity/v3/users/368eb08d62dc4e87a6c0a82b150ef0d5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:22.116255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:22.120096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.141345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 982/1950] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:22.143812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.144528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.145015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.184728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:22.187200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.206053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e7e8a-180b-48e9-814d-f73e1461c8d0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:22.212595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:22.213761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.214268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.214708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.217424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.233695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:22.270173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:22.288809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 983/1951] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:22.288809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:22.289142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.306493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df1c9d-a9b3-4dd5-a220-a5aa81d78e5e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:22.309788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.312620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:22.313530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.313955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.314442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.317118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.333416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 969/1952] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:22.334754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:22.336214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.433870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.436157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.462233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 984/1953] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:22.480375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896432-dadb-4a2a-8f94-d91c05e67ea0 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:22.497067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:22.497768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:22.500344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:22.500682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.501442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.502126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.528608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.534337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1c985-5dab-4562-8683-5a80067b5369 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.538978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962e429-7ba9-464a-8f2c-75e4a7b387e5 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:22.546712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:22.547889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.549238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.549238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] PATH_INFO: `/v3/users/7ddf81400e9f40238038f92da7b964b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.551176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddf81400e9f40238038f92da7b964b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:22.554821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:22.562778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 970/1954] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:22.695039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddf81400e9f40238038f92da7b964b7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.697185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddf81400e9f40238038f92da7b964b7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.714912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddf81400e9f40238038f92da7b964b7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.734765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddf81400e9f40238038f92da7b964b7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.736181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddf81400e9f40238038f92da7b964b7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:22.791473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 985/1955] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:22 2022] DELETE /identity/v3/users/7ddf81400e9f40238038f92da7b964b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:22.812940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:22.812940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:22.812940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:22.881611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:22.884099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:23.089177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 971/1956] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:23.118650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:23.120449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:23.212601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.227712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d331fe6-2b47-40fd-8268-d28114b883a5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:23.234705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:23.236292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.237226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.237512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.251915 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:23.253514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:23.266474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 986/1957] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:23.362829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:23.364596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:23.380518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a47e4-ad90-4a96-8238-f2e085357a6b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:23.396663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:23.397361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.397685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.397952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] PATH_INFO: `/v3/projects/2c418b515d2f4fdda95222531509e912` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.399981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c418b515d2f4fdda95222531509e912)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:23.402796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:23.485259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c418b515d2f4fdda95222531509e912', 'request_id': 'req-e0cca36a-bb18-4f65-b781-53278dfd9af3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.492841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c418b515d2f4fdda95222531509e912', 'request_id': 'req-e0cca36a-bb18-4f65-b781-53278dfd9af3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.500449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c418b515d2f4fdda95222531509e912', 'request_id': 'req-e0cca36a-bb18-4f65-b781-53278dfd9af3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.521704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] The token cache is being invalidate because project 2c418b515d2f4fdda95222531509e912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:23.522122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.522846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.528181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 972/1958] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:23 2022] DELETE /identity/v3/projects/2c418b515d2f4fdda95222531509e912 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:23.529579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:23.540006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ed25-da58-4bb3-a303-195031d3de0e service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:23.616120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:23.616874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.617580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.617580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] PATH_INFO: `/v3/users/de16dd0128e1455c84482ca5328ee6cd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.618846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de16dd0128e1455c84482ca5328ee6cd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:23.621133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:23.695434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:23.699722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:23.713849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de16dd0128e1455c84482ca5328ee6cd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.714978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de16dd0128e1455c84482ca5328ee6cd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.717082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:23.728867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cca36a-bb18-4f65-b781-53278dfd9af3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:23.736474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de16dd0128e1455c84482ca5328ee6cd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.738797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:23.739957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.740478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.741033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] PATH_INFO: `/v3/projects/1b9d6987a3a548be8766c5fc94e5de65` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.743139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9d6987a3a548be8766c5fc94e5de65)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:23.746829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:23.747561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de16dd0128e1455c84482ca5328ee6cd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.748848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3d5c5812-a203-44bf-875c-750fee6a097b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de16dd0128e1455c84482ca5328ee6cd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.775036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 987/1959] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:23 2022] DELETE /identity/v3/users/de16dd0128e1455c84482ca5328ee6cd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:23.846281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9d6987a3a548be8766c5fc94e5de65', 'request_id': 'req-5b98b61d-a330-4e27-b035-6b4395b15766'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.855333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9d6987a3a548be8766c5fc94e5de65', 'request_id': 'req-5b98b61d-a330-4e27-b035-6b4395b15766'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.864900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9d6987a3a548be8766c5fc94e5de65', 'request_id': 'req-5b98b61d-a330-4e27-b035-6b4395b15766'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.883138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] The token cache is being invalidate because project 1b9d6987a3a548be8766c5fc94e5de65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:23.883450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.884111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5b98b61d-a330-4e27-b035-6b4395b15766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:23.885723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 973/1960] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:23 2022] DELETE /identity/v3/projects/1b9d6987a3a548be8766c5fc94e5de65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:23.892724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:23.893347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:23.893627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:23.918869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:23.920466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.050321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 988/1961] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:24.055758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.056149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.056301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.141577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:24.147625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.164224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 974/1962] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:24.172698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.194698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:24.198471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed6e19-1d0c-4b88-907b-e92377611cbc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.217963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.218784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.219064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.219354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.220976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:24.222159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.224350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.274394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.277524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.277909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 989/1963] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:15:24.279807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.299403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6079a10-131c-4d60-8375-dc40ad48fa1b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.306541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.307525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.308282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.308401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.309640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.321424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0a74c-8726-4ffb-9728-3a20e2859036 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.327883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.328921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.329345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.329868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] PATH_INFO: `/v3/projects/1f18c926e63f4b228196c83d1147357b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.329980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.331506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f18c926e63f4b228196c83d1147357b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.334097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.416789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 990/1964] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:24.423373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.478939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f18c926e63f4b228196c83d1147357b', 'request_id': 'req-a9718606-0a88-4312-b2a8-c934ac309a52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:24.492035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f18c926e63f4b228196c83d1147357b', 'request_id': 'req-a9718606-0a88-4312-b2a8-c934ac309a52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:24.504223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f18c926e63f4b228196c83d1147357b', 'request_id': 'req-a9718606-0a88-4312-b2a8-c934ac309a52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:24.531012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] The token cache is being invalidate because project 1f18c926e63f4b228196c83d1147357b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:24.531655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:24.532884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a9718606-0a88-4312-b2a8-c934ac309a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:24.535677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 975/1965] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:24 2022] DELETE /identity/v3/projects/1f18c926e63f4b228196c83d1147357b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:24.543596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ad2-beed-4fef-b050-e5fcded398f5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.544130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ad2-beed-4fef-b050-e5fcded398f5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.544607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ad2-beed-4fef-b050-e5fcded398f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.583901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-36b72ad2-beed-4fef-b050-e5fcded398f5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:24.585888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-36b72ad2-beed-4fef-b050-e5fcded398f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.593606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bc747-5219-4af2-a75f-d7a7a6002f13 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.745848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.746982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 976/1966] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:24.757794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.758359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.758796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.759573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.759987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.760660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.761098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.764660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.777919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:24.811341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 991/1967] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:24.813094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.816011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:24.816237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.823028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:24.844082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ca25b-47a6-4d60-9d86-0199a111affe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.847325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 977/1968] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:24.854283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.859636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.860872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.861351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.861884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.864487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.867634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.871344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36bdc-f4cf-43fd-b173-b0feeeb426bd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.886475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.888115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.888587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.889043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.893910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:24.894548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.895661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 992/1969] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:24.896559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.897554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.917862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a159b8-a2a6-4c16-b17b-a4cbf2e32a9e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:24.926499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:24.927382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:24.927902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:24.928321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:24.929319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:24.931986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:24.940692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 978/1970] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:15:24.946361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:24.960217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 993/1971] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:24.966438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.001171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fcf15-7a3d-4209-b7ad-dd6522bfb8cf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.006846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc1ff-7661-4f54-84ea-838737e93215 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.008660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.009448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.009794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.010115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] PATH_INFO: `/v3/projects/8ad01b1802874334899d595a9fcea284/users/82d96180ce3a45418d06d420fd01b4ad/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.038166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.047243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.047675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.048111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.049246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.061775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad01b1802874334899d595a9fcea284, user_id=82d96180ce3a45418d06d420fd01b4ad, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.064267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.065261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0056-94a1-4991-8349-dbf3cc55042d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.093979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 994/1972] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:24 2022] PUT /identity/v3/projects/8ad01b1802874334899d595a9fcea284/users/82d96180ce3a45418d06d420fd01b4ad/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:25.126116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.126866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.127142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.184299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 979/1973] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:25.186394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.225042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] MFA Rules not processed for user `82d96180ce3a45418d06d420fd01b4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:25.225905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:25.236961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:25.328701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20531bf7-9fca-41a9-95af-7db63bbf84a1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.340829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.341102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 995/1974] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:25.341246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.341246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.341246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.341246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.343342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.344489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.361792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b861ad-5658-489e-8b23-3b894be9c053 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.369955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.371544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.372168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.372636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.374769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.379397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.380211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 980/1975] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:25.386099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.400070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a6e7-2965-473b-ae28-8182ec1562ac admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.414224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.415284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.415687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.416369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.417039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.419211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.432295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 981/1976] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:25.437985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.439133 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 996/1977] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:25.439949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.461608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702594a6-fec3-4872-8c69-3f0ad82e2575 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.550928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba3445-ece5-48bb-a81b-7fdf0d741b82 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.566091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.566736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.567008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.567273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.567927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.570426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.574985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.579310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.580497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.581255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.588951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.588951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.603018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 982/1978] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:25.608429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.613734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 997/1979] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:25.617832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.623385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c9dc-c43d-4cef-ac0b-8caf904b085a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.632061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d5689-3097-4590-87d2-05b8207b1f8f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.632833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.634058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.634735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.635023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] PATH_INFO: `/v3/projects/4aa992d8861a45518d0bdaa27cc60f6a/users/f543609f4d20431490620c4ed4adb350/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.639758 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.641573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.641762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.642219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.643185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.645055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.665777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa992d8861a45518d0bdaa27cc60f6a, user_id=f543609f4d20431490620c4ed4adb350, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.668537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 998/1980] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:25.670911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003b19d-4e1d-477f-a2e2-4659c6a2261c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.682899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.692229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 983/1981] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:25 2022] PUT /identity/v3/projects/4aa992d8861a45518d0bdaa27cc60f6a/users/f543609f4d20431490620c4ed4adb350/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:25.707982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.708413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.709060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.712323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674019bc-74e1-4bf1-95ac-090ab1ce39da admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.754069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:25.816134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] MFA Rules not processed for user `f543609f4d20431490620c4ed4adb350`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:25.817692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:25.928197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.929053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:25.929791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:25.930097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:25.931067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:25.933270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:25.951038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 999/1982] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:25.953897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:25.962161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:25.972545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b9e1-845b-48b2-bf0c-1bab95ddc6c3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:25.979432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 984/1983] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:25.983466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:25.987982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.006376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.006831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.009271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] PATH_INFO: `/v3/projects/ea188b2e44a042ae93f10f3353fa339f/users/bb1af20562e643668f0898b5c726d606/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.010301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e3452-5d7d-459b-af05-719a42b1b367 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.019887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.020874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.021251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.021659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.022730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.026906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.054266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea188b2e44a042ae93f10f3353fa339f, user_id=bb1af20562e643668f0898b5c726d606, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.057218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde6ae-edaa-44d8-84d0-338c3e1a5213 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.073251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 985/1984] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:25 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:26.075236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1000/1985] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:25 2022] PUT /identity/v3/projects/ea188b2e44a042ae93f10f3353fa339f/users/bb1af20562e643668f0898b5c726d606/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:26.077212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.089544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.091264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.092946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.168794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] MFA Rules not processed for user `bb1af20562e643668f0898b5c726d606`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:26.170458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:26.267182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ace18-e295-4f34-8d19-6338d7987207 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.292472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.293806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.295463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.295875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.298541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.310118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.446120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 986/1986] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:26 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:26.448679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1001/1987] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:26.458138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.467118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.503760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da086-1a87-4531-8c47-bed939456563 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.525232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02251-330a-4a9e-bf49-8e97bba3d9c0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.525550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.526160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.528847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.529275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.533462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.538589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.539459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.539946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.540514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.541005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.542324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.545878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.578299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 987/1988] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:26.586179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.604850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed202a-8813-4cf4-908d-bf9df834b882 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.629463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.630258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.631343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.632255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.637241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.652098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1002/1989] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:26 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:26.653488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.659196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.709415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 988/1990] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:26.719522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.738051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca225-6104-48b1-89f0-84e8ef6381b5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.880363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a58d3-54f3-4c88-8476-f4541785f984 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.890750 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.891994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.893296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.893296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.894645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.897884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:26.898616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.929842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.931769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1003/1991] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:26 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:26.933454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.934752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.935268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] PATH_INFO: `/v3/projects/36b64ea106484eb8a705063517a5b4f0/users/9006f6ce32ba472caa5cb2090506e850/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.936176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:26.948339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd3f0c-7779-4a30-be27-79a68de50a67 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:26.955580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:26.956274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:26.956548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:26.956848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:26.957505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.959441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.967426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b64ea106484eb8a705063517a5b4f0, user_id=9006f6ce32ba472caa5cb2090506e850, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:26.970878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ba8a4-3fc5-4b5f-9e82-668f902a5fd8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:26.982138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1004/1992] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:26.993216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.004796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 989/1993] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:26 2022] PUT /identity/v3/projects/36b64ea106484eb8a705063517a5b4f0/users/9006f6ce32ba472caa5cb2090506e850/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:27.020908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.021266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.021438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.023413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387d0f7-f5d8-44b3-bfbf-068b2ffe6019 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.104671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:27.105804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] MFA Rules not processed for user `9006f6ce32ba472caa5cb2090506e850`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:27.110205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.196945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.197671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.198142 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.198401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] PATH_INFO: `/v3/projects/beea61b1d23f4ff985a110f51e310927/users/318bcdff383345e1a6b32a52ff3658a6/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.221632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=beea61b1d23f4ff985a110f51e310927, user_id=318bcdff383345e1a6b32a52ff3658a6, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.224807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.246102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 990/1994] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:27.252444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.263438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1005/1995] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:26 2022] PUT /identity/v3/projects/beea61b1d23f4ff985a110f51e310927/users/318bcdff383345e1a6b32a52ff3658a6/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:27.267851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.278405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0a74-d174-45b3-8d5d-f2b74ece6525 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.376257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.377091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.377205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.377516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.378174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.380134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.387669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99537747-9589-4aad-9863-d1095996cffb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.394874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.395741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.396026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.396294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.396999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.398962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.412267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1006/1996] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:27.413161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.414879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.418254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 991/1997] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:27 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:27.419238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.442566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ce381-802f-4912-9a42-75fe283821ff admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.489856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:27.519392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99612103-5b3a-4fc9-b120-7ba8c53879c2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.533636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.534563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.535122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.535764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] PATH_INFO: `/v3/projects/beea61b1d23f4ff985a110f51e310927/users/318bcdff383345e1a6b32a52ff3658a6/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.538864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beea61b1d23f4ff985a110f51e310927, user_id=318bcdff383345e1a6b32a52ff3658a6, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.546132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.551627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.552298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.553892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.553892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] PATH_INFO: `/v3/users/43ea73b6c0a14099a3c8d67cf1a72573` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.556004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ea73b6c0a14099a3c8d67cf1a72573)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.558094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.578068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 992/1998] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:27 2022] PUT /identity/v3/projects/beea61b1d23f4ff985a110f51e310927/users/318bcdff383345e1a6b32a52ff3658a6/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:27.580916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.675304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:27.684372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ea73b6c0a14099a3c8d67cf1a72573'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:27.685213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ea73b6c0a14099a3c8d67cf1a72573'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:27.696485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ea73b6c0a14099a3c8d67cf1a72573'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:27.709239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ea73b6c0a14099a3c8d67cf1a72573'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:27.710573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8dac8607-a54d-4943-86a8-52137bc040d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ea73b6c0a14099a3c8d67cf1a72573'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:27.742324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1007/1999] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:27 2022] DELETE /identity/v3/users/43ea73b6c0a14099a3c8d67cf1a72573 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:27.743620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bf513-9f78-4746-bd87-5f08c8877df3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.745714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.746190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.746643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.799295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] MFA Rules not processed for user `318bcdff383345e1a6b32a52ff3658a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:27.801042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.819248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.820048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.820417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.820847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.821638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.824396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172fa2-c8ba-4db3-bc8d-434bb8842212 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.858630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 993/2000] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:27 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:27.858630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.858630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.858630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.899200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:27.901379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.909844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 994/2001] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:27.910713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.913881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.933751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f5b27-8222-42ce-990c-3fc07571b10d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:27.937200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1008/2002] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:27.938140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.939468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:27.939740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:27.940439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:27.940796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:27.949670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:27.950502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:27.952497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:27.972323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 995/2003] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:27.972323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:27.975244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:28.020253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ea26d-ce45-4f7f-a427-1e341c745595 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.036425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.039031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.039956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.040497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.063804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:28.065718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:28.077077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1009/2004] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:28.078234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:28.081491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c9e1-0c3f-44f2-ba8f-e8167f2d8b39 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.086884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.087747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.088247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.088587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.090620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:28.090842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07360-bb9d-466f-873d-3345b470704b service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.099774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.100641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.100948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.101219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] PATH_INFO: `/v3/projects/01f333f941be48f4b57fa8f23868670f/users/e64c4bff0b84403dab5c4a1abfa82114/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.105758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:28.131262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f333f941be48f4b57fa8f23868670f, user_id=e64c4bff0b84403dab5c4a1abfa82114, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:28.136116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:28.165830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1010/2005] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:28 2022] PUT /identity/v3/projects/01f333f941be48f4b57fa8f23868670f/users/e64c4bff0b84403dab5c4a1abfa82114/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:28.170774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:28.239154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:28.243115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:28.273565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 996/2006] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:28.275887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:28.361329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650479e-deea-4e4f-aac5-6850ce90e657 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.382676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.383902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.384682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.384978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.385646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:28.387439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807272f-cba8-49b5-934b-8c45c92a06a6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:28.402739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1011/2007] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:28.407276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:28.423713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cc146-404a-4626-9fa1-74833552b44d service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.428671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.429587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.429875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.430150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] PATH_INFO: `/v3/projects/01f333f941be48f4b57fa8f23868670f/users/e64c4bff0b84403dab5c4a1abfa82114/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.432715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f333f941be48f4b57fa8f23868670f, user_id=e64c4bff0b84403dab5c4a1abfa82114, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:28.437202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:28.466834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.467279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.467772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:28.471663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 997/2008] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:28 2022] PUT /identity/v3/projects/01f333f941be48f4b57fa8f23868670f/users/e64c4bff0b84403dab5c4a1abfa82114/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:28.537402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] MFA Rules not processed for user `e64c4bff0b84403dab5c4a1abfa82114`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:28.538853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:28.676804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1012/2009] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:28.802905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:28.805377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:28.982206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e49a-4419-45a4-972d-98e1b345a834 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:28.987556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:28.988257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:28.988528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:28.988790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:29.009144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:29.010932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:29.024433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 998/2010] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:29.089040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:29.100700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3df1-5b6a-4fd2-acd4-53ab2dd6a4c0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:29.107043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:29.108126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:29.108402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:29.108716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:29.111103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:29.181777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:29.183216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:29.194715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:29.195309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1013/2011] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:29.196325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:29.330330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e77cda-f86d-44d1-b730-4a8015a90b3f service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:29.339758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:29.341167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:29.341604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:29.342220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] PATH_INFO: `/v3/projects/fd2fed4f971f417aa0284b3f454856df` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:29.343718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2fed4f971f417aa0284b3f454856df)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:29.346630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:29.416434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:29.423409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2fed4f971f417aa0284b3f454856df', 'request_id': 'req-21dbbfff-723d-4cba-abc7-cbd655edbd51'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.432863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2fed4f971f417aa0284b3f454856df', 'request_id': 'req-21dbbfff-723d-4cba-abc7-cbd655edbd51'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.441538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2fed4f971f417aa0284b3f454856df', 'request_id': 'req-21dbbfff-723d-4cba-abc7-cbd655edbd51'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.457267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] The token cache is being invalidate because project fd2fed4f971f417aa0284b3f454856df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:29.457633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.458576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.461119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 999/2012] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:29 2022] DELETE /identity/v3/projects/fd2fed4f971f417aa0284b3f454856df => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:29.465711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:29.480167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed3ab-5e92-401f-b9df-d0c93c9d1c55 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:29.541786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:29.561959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:29.562717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:29.563050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:29.563365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] PATH_INFO: `/v3/users/9e9afd1d5a654c7db631e1ca555a9490` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:29.565169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9afd1d5a654c7db631e1ca555a9490)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:29.567367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:29.655994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9afd1d5a654c7db631e1ca555a9490'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.656995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9afd1d5a654c7db631e1ca555a9490'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.670787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9afd1d5a654c7db631e1ca555a9490'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.687582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9afd1d5a654c7db631e1ca555a9490'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.688625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-159a337d-31bb-473e-9303-e7ecf583a8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9afd1d5a654c7db631e1ca555a9490'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:29.713858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1014/2013] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:29 2022] DELETE /identity/v3/users/9e9afd1d5a654c7db631e1ca555a9490 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:30.028257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.030122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:30.046233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbbfff-723d-4cba-abc7-cbd655edbd51 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.121178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.121897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.122211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.123083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] PATH_INFO: `/v3/projects/32150a43ee7748f095d8b15833efed96` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.124713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32150a43ee7748f095d8b15833efed96)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.127177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.205242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32150a43ee7748f095d8b15833efed96', 'request_id': 'req-741e7701-ee40-4cd7-81d9-03fc9b743ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:30.213907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32150a43ee7748f095d8b15833efed96', 'request_id': 'req-741e7701-ee40-4cd7-81d9-03fc9b743ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:30.223234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32150a43ee7748f095d8b15833efed96', 'request_id': 'req-741e7701-ee40-4cd7-81d9-03fc9b743ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:30.241594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] The token cache is being invalidate because project 32150a43ee7748f095d8b15833efed96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:30.242036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:30.242885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:30.244806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1000/2014] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:30 2022] DELETE /identity/v3/projects/32150a43ee7748f095d8b15833efed96 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:30.249971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565164-e39c-441e-b9df-574bfe66cbfb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.251671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565164-e39c-441e-b9df-574bfe66cbfb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.251671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565164-e39c-441e-b9df-574bfe66cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.274907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dd565164-e39c-441e-b9df-574bfe66cbfb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:30.276124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd565164-e39c-441e-b9df-574bfe66cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:30.327061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.328979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:30.368500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1015/2015] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:30.376944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.377249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.377488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.399927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:30.401211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:30.409084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7701-ee40-4cd7-81d9-03fc9b743ce1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.410822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1016/2016] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:30.413512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.414513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.414852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.415005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.415473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.418021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:30.424307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df84e-ac60-4668-af48-a295c871b307 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.429268 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.429888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.430161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.430478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.431135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:30.431427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.433044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.436497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:30.451518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1017/2017] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:15:30.455822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.468031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8287-3170-418b-a078-a0fb07d65805 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.473863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.474471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.474949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.475374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.476452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.478694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.499205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.500965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.515315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1001/2018] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:30.515514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1018/2019] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:30 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:30.521664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.541716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938cf5e-a549-4d17-bae3-bdfbd3d0fc1e service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.614691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.615439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.615793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.616470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.617235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.619285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.648297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1002/2020] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:30 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:30.658466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.687439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea2229-a0ac-40db-91d6-ed5a1f03cf42 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.697659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.698275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.698545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.698810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.699474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.702467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.727869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1019/2021] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:30.729703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.753639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068feb-1956-48ec-baae-d6b9a084742c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.767640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.768531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.768784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.769026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.769937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.772817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1099e-cfc0-4246-b302-2cc40001fcca admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.788493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1003/2022] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:30.793227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:30.813069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c008-1f18-4928-8151-2d6f71e16568 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:30.846285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:30.848183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.848183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.848760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] PATH_INFO: `/v3/projects/c30a905dd3bb4fa3b3b575d8627e492a/users/31c5b8aed2444dbca86b31d8f199220f/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.874548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:30.878793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30a905dd3bb4fa3b3b575d8627e492a, user_id=31c5b8aed2444dbca86b31d8f199220f, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:30.882239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:30.910900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1020/2023] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:30 2022] PUT /identity/v3/projects/c30a905dd3bb4fa3b3b575d8627e492a/users/31c5b8aed2444dbca86b31d8f199220f/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:30.922944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:30.923499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:30.923858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:30.962210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] MFA Rules not processed for user `31c5b8aed2444dbca86b31d8f199220f`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:30.963897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:31.058638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1004/2024] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:31.063822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.154599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464746a1-8f14-49ca-8dbe-286fd41418c7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.160579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.161347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.161662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.161922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.165270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.169507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.219212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1021/2025] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:31 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:31.220708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.243927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ddde-17dd-4e9a-a92a-7df2ea473ba4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.281213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:31.347848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.348052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.348871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.349228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.349586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.350418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.352653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.384781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1005/2026] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:31 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:31.389980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.402224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680df1d-4f85-48fe-8af8-416a4ca7a13d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.407351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.409253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.409253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.409253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.409253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.410993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.421285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d1e4d-efd5-444f-a6ad-535f65f6868f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.423146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1006/2027] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:31.425570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.426457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.427472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.428192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.428465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.432292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:31.441719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e62a3-3065-4b19-8c98-a12fbf626716 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.447476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.448223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.448487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.448780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] PATH_INFO: `/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff/users/69ea9294507c4c54bc4e3b7c387548f3/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.467878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfc1174e6bb4f79a1d4af889c371fff, user_id=69ea9294507c4c54bc4e3b7c387548f3, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.470678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.491730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1007/2028] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:31 2022] PUT /identity/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff/users/69ea9294507c4c54bc4e3b7c387548f3/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:31.495548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.519589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.521297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.534938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1022/2029] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:31.574998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cb410-2fcf-47c5-b770-8dd28fc34499 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.581839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.582438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.583316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.583316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.583717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.585402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53235f55-81ab-4a82-9589-423acbd8fbba admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.598661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1008/2030] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:31.614278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.640459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035f21-1636-4cca-8666-8e88429f3bb6 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.646121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.647361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.647808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.648446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] PATH_INFO: `/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff/users/69ea9294507c4c54bc4e3b7c387548f3/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.651524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfc1174e6bb4f79a1d4af889c371fff, user_id=69ea9294507c4c54bc4e3b7c387548f3, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.655897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.681459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1023/2031] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:31 2022] PUT /identity/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff/users/69ea9294507c4c54bc4e3b7c387548f3/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:31.692996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.693359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.693705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.734350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] MFA Rules not processed for user `69ea9294507c4c54bc4e3b7c387548f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:31.735684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:31.824605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:31.828849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1009/2032] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:31.842642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:31.868777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:31.940614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8d92-97a7-43e9-816e-d662fbe4060c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:31.944510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:31.945197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:31.945655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:31.945935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:31.956874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:31.958269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:31.971018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1024/2033] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:32.057167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:32.058849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:32.073600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08321a-baf6-4be7-ac36-6b6b6c61022b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:32.077661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:32.078473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.078588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.078834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.163750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:32.166279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c73dd1-7baf-4a99-995f-1551e28cae1e service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:32.177869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1010/2034] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:32.523453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:32.525685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:32.703647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68abe-c3e6-4f37-881c-16ab316a40d0 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:32.709746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:32.710418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.710690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.711119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] PATH_INFO: `/v3/users/f543609f4d20431490620c4ed4adb350` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.712895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f543609f4d20431490620c4ed4adb350)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:32.715070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:32.802844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f543609f4d20431490620c4ed4adb350'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:32.804007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f543609f4d20431490620c4ed4adb350'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:32.818867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f543609f4d20431490620c4ed4adb350'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:32.830510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f543609f4d20431490620c4ed4adb350'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:32.831918 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f543609f4d20431490620c4ed4adb350'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:32.862410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1025/2035] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:32 2022] DELETE /identity/v3/users/f543609f4d20431490620c4ed4adb350 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:32.867698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:32.868900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:32.869515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:32.896830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:32.899440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:33.027119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1011/2036] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:33.027601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:33.029226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:33.136715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:33.189796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8b3a1-8ad2-4ea1-bb35-69beb8c0c8a4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:33.194352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:33.195376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:33.195837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:33.196286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:33.213132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:33.215535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:33.235815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1026/2037] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:33.611733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:33.614043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:33.638777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90ccf-f94f-4df1-87c2-4de72c490321 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:33.648869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:33.649898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:33.650455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:33.651356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] PATH_INFO: `/v3/projects/4aa992d8861a45518d0bdaa27cc60f6a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:33.657690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa992d8861a45518d0bdaa27cc60f6a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:33.662263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:33.796535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa992d8861a45518d0bdaa27cc60f6a', 'request_id': 'req-4951d844-883d-451b-9dc1-b9b8e589b30a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:33.813741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa992d8861a45518d0bdaa27cc60f6a', 'request_id': 'req-4951d844-883d-451b-9dc1-b9b8e589b30a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:33.821357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa992d8861a45518d0bdaa27cc60f6a', 'request_id': 'req-4951d844-883d-451b-9dc1-b9b8e589b30a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:33.854911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] The token cache is being invalidate because project 4aa992d8861a45518d0bdaa27cc60f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:33.855280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:33.856388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:33.863666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1012/2038] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:33 2022] DELETE /identity/v3/projects/4aa992d8861a45518d0bdaa27cc60f6a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:33.865169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:33.902180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720363b2-0141-40aa-aec2-a79dcea1d8d3 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:34.064336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:34.064654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:34.064954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:34.065563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] PATH_INFO: `/v3/users/9006f6ce32ba472caa5cb2090506e850` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:34.067063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9006f6ce32ba472caa5cb2090506e850)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:34.069272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:34.192154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9006f6ce32ba472caa5cb2090506e850'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:34.195323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9006f6ce32ba472caa5cb2090506e850'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:34.247740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9006f6ce32ba472caa5cb2090506e850'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:34.282020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9006f6ce32ba472caa5cb2090506e850'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:34.282810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8c4247d0-9cff-4ff2-8dec-da645d230332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9006f6ce32ba472caa5cb2090506e850'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:34.339314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1027/2039] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:33 2022] DELETE /identity/v3/users/9006f6ce32ba472caa5cb2090506e850 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:35.020023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.025753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.043617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951d844-883d-451b-9dc1-b9b8e589b30a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.069427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a27f-d9cc-4a48-ba31-60a0f2701e58 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.069427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a27f-d9cc-4a48-ba31-60a0f2701e58 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.069427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328a27f-d9cc-4a48-ba31-60a0f2701e58 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.070709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1028/2040] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 20:15:35.074788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:35.111080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.111631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.112978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.134817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.135926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.136190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.136463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] PATH_INFO: `/v3/projects/36b64ea106484eb8a705063517a5b4f0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.137719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b64ea106484eb8a705063517a5b4f0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.140336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.160826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] MFA Rules not processed for user `e661de36a7dc4a4b9e265fe10da1fad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:35.165746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.197699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b64ea106484eb8a705063517a5b4f0', 'request_id': 'req-f8e49615-508a-4ecd-ab24-8966e2056d52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.205506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b64ea106484eb8a705063517a5b4f0', 'request_id': 'req-f8e49615-508a-4ecd-ab24-8966e2056d52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.211646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b64ea106484eb8a705063517a5b4f0', 'request_id': 'req-f8e49615-508a-4ecd-ab24-8966e2056d52'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.223131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:35.228791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] The token cache is being invalidate because project 36b64ea106484eb8a705063517a5b4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:35.229085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.229995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.232157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1013/2041] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:35 2022] DELETE /identity/v3/projects/36b64ea106484eb8a705063517a5b4f0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:35.235702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.235702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.244162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1029/2042] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:35.244950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.248034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.264444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67034354-d4db-40b1-af11-6e3716912f15 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.322804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49615-508a-4ecd-ab24-8966e2056d52 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.328568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.329606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.329951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.330281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] PATH_INFO: `/v3/users/a48be8d8f3df4819bcaf18ddda2ef359` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.330889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.331702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48be8d8f3df4819bcaf18ddda2ef359)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.331822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.332066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.332360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] PATH_INFO: `/v3/users/e64c4bff0b84403dab5c4a1abfa82114` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.333691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64c4bff0b84403dab5c4a1abfa82114)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.334048 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.335925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.392049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64c4bff0b84403dab5c4a1abfa82114'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.392692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64c4bff0b84403dab5c4a1abfa82114'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.400724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64c4bff0b84403dab5c4a1abfa82114'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.403677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48be8d8f3df4819bcaf18ddda2ef359'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.410390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64c4bff0b84403dab5c4a1abfa82114'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.410870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:35.411035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64c4bff0b84403dab5c4a1abfa82114'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.414664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48be8d8f3df4819bcaf18ddda2ef359'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.429931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48be8d8f3df4819bcaf18ddda2ef359'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.430663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48be8d8f3df4819bcaf18ddda2ef359'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.431274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48be8d8f3df4819bcaf18ddda2ef359'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.431760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1030/2043] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:35 2022] DELETE /identity/v3/users/e64c4bff0b84403dab5c4a1abfa82114 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:35.432712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.436679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.448932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1014/2044] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:35 2022] DELETE /identity/v3/users/a48be8d8f3df4819bcaf18ddda2ef359 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:35.535253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb289b-610b-4c0a-810c-f967ac8f8185 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.552296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:35.627891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.629085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.639725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.640346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.642678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.659715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.661403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.676724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1031/2045] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:35.692857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.695477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.777879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09962c-d197-4fbd-b050-4c9e545b38aa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.787441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.788228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.788445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.788784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] PATH_INFO: `/v3/projects/9acea5edc9c849c38cb58cda3b8ff592` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.790559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9acea5edc9c849c38cb58cda3b8ff592)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.793075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.816134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:35.818075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:35.868964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e53e39-cded-497c-bd74-e63124faac7d service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:35.884176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:35.888659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.889255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.889715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] PATH_INFO: `/v3/projects/01f333f941be48f4b57fa8f23868670f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.895073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9acea5edc9c849c38cb58cda3b8ff592', 'request_id': 'req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.904490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9acea5edc9c849c38cb58cda3b8ff592', 'request_id': 'req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.912836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f333f941be48f4b57fa8f23868670f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:35.913979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9acea5edc9c849c38cb58cda3b8ff592', 'request_id': 'req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.918065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:35.935195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] The token cache is being invalidate because project 9acea5edc9c849c38cb58cda3b8ff592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:35.936819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.938057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bfcfe934-1b45-4a4d-a98a-2f52dfe7877d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:35.940289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1015/2046] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:35 2022] DELETE /identity/v3/projects/9acea5edc9c849c38cb58cda3b8ff592 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:35.946973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9618-bc1f-43e4-b4e3-6ed6887c2ab4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:35.947255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9618-bc1f-43e4-b4e3-6ed6887c2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:35.947551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9618-bc1f-43e4-b4e3-6ed6887c2ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:35.976445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d1fd9618-bc1f-43e4-b4e3-6ed6887c2ab4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:35.977896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d1fd9618-bc1f-43e4-b4e3-6ed6887c2ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.012110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f333f941be48f4b57fa8f23868670f', 'request_id': 'req-d6ae8bed-041e-4e59-851f-d99122bd486d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.020164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f333f941be48f4b57fa8f23868670f', 'request_id': 'req-d6ae8bed-041e-4e59-851f-d99122bd486d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.027312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f333f941be48f4b57fa8f23868670f', 'request_id': 'req-d6ae8bed-041e-4e59-851f-d99122bd486d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.042465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] The token cache is being invalidate because project 01f333f941be48f4b57fa8f23868670f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:36.042997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.043853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.046013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1032/2047] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:35 2022] DELETE /identity/v3/projects/01f333f941be48f4b57fa8f23868670f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:36.047207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.048663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.054489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1016/2048] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.055772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827c0d-84a8-4d16-be72-05de88938693 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.056066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827c0d-84a8-4d16-be72-05de88938693 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.056334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827c0d-84a8-4d16-be72-05de88938693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.064699 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:36.083739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-94827c0d-84a8-4d16-be72-05de88938693 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:36.085130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-94827c0d-84a8-4d16-be72-05de88938693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.132895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8bed-041e-4e59-851f-d99122bd486d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.140514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.141799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.142297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.142799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] PATH_INFO: `/v3/users/82d96180ce3a45418d06d420fd01b4ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.144767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d96180ce3a45418d06d420fd01b4ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.148091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.158210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1017/2049] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.166734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13015c3-1b9b-4a43-ba29-49240c9f9c07 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.166734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13015c3-1b9b-4a43-ba29-49240c9f9c07 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.166734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13015c3-1b9b-4a43-ba29-49240c9f9c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.188253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d13015c3-1b9b-4a43-ba29-49240c9f9c07 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:36.191814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d13015c3-1b9b-4a43-ba29-49240c9f9c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.202757 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:36.204451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1018/2050] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.206205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.206496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.206766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.229412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d96180ce3a45418d06d420fd01b4ad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.230017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d96180ce3a45418d06d420fd01b4ad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.232016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:36.234132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.239577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d96180ce3a45418d06d420fd01b4ad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.251327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1019/2051] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.252228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.261707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d96180ce3a45418d06d420fd01b4ad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.263025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d96180ce3a45418d06d420fd01b4ad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.264898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ec1e7-8ac8-4af3-ae98-0f08a49b0a4e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.274522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.275515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.276006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.276502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.277757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:36.278285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.281981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02098e-1dfe-4fba-a76b-dbeb3af3ccb5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.285405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1033/2052] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:36 2022] DELETE /identity/v3/users/82d96180ce3a45418d06d420fd01b4ad => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:36.285991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.287449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.308438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1020/2053] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:36.309802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.310148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.310601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.335579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:36.336976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.429528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438b81-2cc9-476e-980b-d9d0359ea209 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.436987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.437630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.437969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.438207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.439193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:36.439529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.441135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1021/2054] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.441400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.441984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.446588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.461353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1034/2055] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:36.461353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.461657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfe021-bb85-4618-bf44-f35232555229 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.461751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.463851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.464499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.464807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.465079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.465719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.468172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.475924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bad6-87f7-4f5c-ad66-9650d78f1fc9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.480672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.481335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.481612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.481883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] PATH_INFO: `/v3/users/31c5b8aed2444dbca86b31d8f199220f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.484240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c5b8aed2444dbca86b31d8f199220f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.486459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.498427 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1022/2056] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:36.499866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.501145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.547405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c5b8aed2444dbca86b31d8f199220f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.548139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c5b8aed2444dbca86b31d8f199220f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.556251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c5b8aed2444dbca86b31d8f199220f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.565070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b694659-ec7c-4718-9596-1c2a0c059ce6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.567177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c5b8aed2444dbca86b31d8f199220f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.567933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c5b8aed2444dbca86b31d8f199220f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:36.569451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.570062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.570335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.570595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.572554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.582698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:36.597009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1035/2057] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:36 2022] DELETE /identity/v3/users/31c5b8aed2444dbca86b31d8f199220f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:36.597953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.599344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.614199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:36.650969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.652317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.663328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1023/2058] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:36.664290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.665943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.680357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec55d4-3097-4fc8-a75d-dc26bf73ca0a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.681155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31a348-e646-495d-9e06-695a2bcd798c service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.686513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.687050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.687356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.687474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.687773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.688222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.688419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.688515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.688777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.689712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.690372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.691665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b8443-156b-4357-a272-89e20ebf9d31 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.725152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1024/2059] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:36.727015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.727301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.727574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.732942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1036/2060] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:36.734267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.782435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:36.784242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.836887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05a3ab-5290-4de1-a8f7-0d6a526759a6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.843895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.844567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.845203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.845462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.846428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.849016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.864977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1037/2061] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:36.864977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.877304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1025/2062] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:36.878341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.886612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e85ffb-a95d-4891-a56c-eb0a88b0dad0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.892172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.892978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.893422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.895022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.895022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.896558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.899334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b5cca-59e8-41f0-8481-f702851b72dc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.906891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.908231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.908492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.909250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.910329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.912478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.923246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1038/2063] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:36 2022] POST /identity/v3/users => generated 294 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:36.924416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.927280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:36.931994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1026/2064] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:36.931994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.940842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b113-3020-4c4b-8658-12132a701d7e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:36.946220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:36.946841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:36.947284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:36.947547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:36.948199 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:36.949883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:36.963037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1027/2065] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:36.964219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:36.984865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19de3cd-205d-4240-bd7d-2ee012d6c787 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.007496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.008461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.008839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.009237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] PATH_INFO: `/v3/projects/f7b6541a001c45e8a10b0f4b1f477c2e/users/5386ae3d06014ebbb3c821a8ccea3caf/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.030989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b6541a001c45e8a10b0f4b1f477c2e, user_id=5386ae3d06014ebbb3c821a8ccea3caf, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.033921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.047253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96308a1a-1b71-43bb-a8d9-6649fa50f645 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.054126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1028/2066] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:36 2022] PUT /identity/v3/projects/f7b6541a001c45e8a10b0f4b1f477c2e/users/5386ae3d06014ebbb3c821a8ccea3caf/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:37.055526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.090139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:37.115761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.116385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.116654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.116951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.139023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:37.171448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d2086-036b-45e7-9948-3f1c629e2d96 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.182604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.183618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.184326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.184873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.186928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.188094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.190078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.190273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fef32-dc0a-4218-91c2-bf6a5c8367f9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.201478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1039/2067] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:37.202770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.204507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.210287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1029/2068] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:37.212661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.213178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.213670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.219978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7f4b4-f7c8-4840-b82f-3d7e2e4b5ace service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.225881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.226898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.227319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.227731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] PATH_INFO: `/v3/projects/8ad01b1802874334899d595a9fcea284` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.229109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad01b1802874334899d595a9fcea284)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.231606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.258421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] MFA Rules not processed for user `5386ae3d06014ebbb3c821a8ccea3caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:37.259747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.313303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad01b1802874334899d595a9fcea284', 'request_id': 'req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.335042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad01b1802874334899d595a9fcea284', 'request_id': 'req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.346258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad01b1802874334899d595a9fcea284', 'request_id': 'req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.364773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] The token cache is being invalidate because project 8ad01b1802874334899d595a9fcea284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:37.365112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.365734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.367615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1040/2069] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:37 2022] DELETE /identity/v3/projects/8ad01b1802874334899d595a9fcea284 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:37.367736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1030/2070] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:37.368188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.369599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.374043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.389116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6de05-9a40-4822-8440-87c91d0754f7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.504052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.505074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.505504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.505953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] PATH_INFO: `/v3/users/bb1af20562e643668f0898b5c726d606` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.507841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1af20562e643668f0898b5c726d606)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.509665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81e3fb-4a1b-4f40-813d-3e981e27bc99 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.511625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.517650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.518686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.519119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.519548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] PATH_INFO: `/v3/projects/be8d18c5c891416bbbfe7152f7a46e80/users/2c95041f55424aa2ac1096399f2ed118/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.533692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:37.544323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d18c5c891416bbbfe7152f7a46e80, user_id=2c95041f55424aa2ac1096399f2ed118, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.551102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.588788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1041/2071] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:37 2022] PUT /identity/v3/projects/be8d18c5c891416bbbfe7152f7a46e80/users/2c95041f55424aa2ac1096399f2ed118/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:37.588788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.596314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1af20562e643668f0898b5c726d606'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.598120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.609962 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1af20562e643668f0898b5c726d606'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.627671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:37.630502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1af20562e643668f0898b5c726d606'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.631727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1af20562e643668f0898b5c726d606'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.632602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1af20562e643668f0898b5c726d606'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.661136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1031/2072] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:37 2022] DELETE /identity/v3/users/bb1af20562e643668f0898b5c726d606 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:37.661981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.663457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.702117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2b6e-d91c-4298-9b08-e979631f3b16 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.748789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a480fc-79a1-437e-8b89-b3be53be2a11 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.754264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.765593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.765884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.766158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] PATH_INFO: `/v3/projects/c30a905dd3bb4fa3b3b575d8627e492a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.770028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30a905dd3bb4fa3b3b575d8627e492a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.772321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.809563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:37.810665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.811007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.811804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.813953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.858715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30a905dd3bb4fa3b3b575d8627e492a', 'request_id': 'req-0f68c233-9f9e-4278-b161-b323ef1e2089'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.867876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30a905dd3bb4fa3b3b575d8627e492a', 'request_id': 'req-0f68c233-9f9e-4278-b161-b323ef1e2089'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.875408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30a905dd3bb4fa3b3b575d8627e492a', 'request_id': 'req-0f68c233-9f9e-4278-b161-b323ef1e2089'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.889524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:37.891639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] The token cache is being invalidate because project c30a905dd3bb4fa3b3b575d8627e492a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:37.891795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:37.891939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.892607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0f68c233-9f9e-4278-b161-b323ef1e2089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:37.896785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1032/2073] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:37 2022] DELETE /identity/v3/projects/c30a905dd3bb4fa3b3b575d8627e492a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:37.896785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:37.896785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:37.896785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:37.906950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1042/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:37.908193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:37.922602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8714f-c61b-4981-b3ef-d689cec92e38 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:37.931711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] MFA Rules not processed for user `2c95041f55424aa2ac1096399f2ed118`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:37.931711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:37.947489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.048806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.048806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.048806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.048806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] PATH_INFO: `/v3/users/69ea9294507c4c54bc4e3b7c387548f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.049372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1033/2075] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:38.049463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ea9294507c4c54bc4e3b7c387548f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.051711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.053465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.064132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.086270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a26bf-6b19-48d7-98d4-8df7817158a2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.092526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.093244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.093605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.093958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.094848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.097018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.105148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.142851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1034/2076] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:38 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:38.143900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.146997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.147346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ea9294507c4c54bc4e3b7c387548f3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.148787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ea9294507c4c54bc4e3b7c387548f3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.155656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ea9294507c4c54bc4e3b7c387548f3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.165220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ea9294507c4c54bc4e3b7c387548f3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.168441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ea9294507c4c54bc4e3b7c387548f3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.195833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1043/2077] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:37 2022] DELETE /identity/v3/users/69ea9294507c4c54bc4e3b7c387548f3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:38.197366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.198700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.245803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168a04-7af8-4ba2-9d77-d6de825e5bc1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.280022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e76941-206a-43bb-ac5d-d2856f235095 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.286792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.287666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.288123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.288566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.289422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.292191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.323475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.324345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.324631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.325088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] PATH_INFO: `/v3/projects/ea188b2e44a042ae93f10f3353fa339f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.325370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1044/2078] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:38 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:38.327214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.330740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea188b2e44a042ae93f10f3353fa339f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.331086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.344638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.349461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ff836-5b64-4d33-bae1-afd0f7807afd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.354607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.355387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.355761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.356123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] PATH_INFO: `/v3/users/5386ae3d06014ebbb3c821a8ccea3caf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.357919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5386ae3d06014ebbb3c821a8ccea3caf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.360164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.394981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.420497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5386ae3d06014ebbb3c821a8ccea3caf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.421698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5386ae3d06014ebbb3c821a8ccea3caf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.430779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea188b2e44a042ae93f10f3353fa339f', 'request_id': 'req-e0f56a44-2d08-499b-8cb5-640f591a91b1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.432097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5386ae3d06014ebbb3c821a8ccea3caf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.437694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea188b2e44a042ae93f10f3353fa339f', 'request_id': 'req-e0f56a44-2d08-499b-8cb5-640f591a91b1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.444418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea188b2e44a042ae93f10f3353fa339f', 'request_id': 'req-e0f56a44-2d08-499b-8cb5-640f591a91b1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.445527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5386ae3d06014ebbb3c821a8ccea3caf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.446586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5386ae3d06014ebbb3c821a8ccea3caf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.459831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] The token cache is being invalidate because project ea188b2e44a042ae93f10f3353fa339f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:38.460128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.461114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.462669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1035/2079] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:38 2022] DELETE /identity/v3/projects/ea188b2e44a042ae93f10f3353fa339f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:38.467231 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.469446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.479124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1045/2080] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:38 2022] DELETE /identity/v3/users/5386ae3d06014ebbb3c821a8ccea3caf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:38.479124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.479124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.509128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.592225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f56a44-2d08-499b-8cb5-640f591a91b1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.598257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.598981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.599258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.599522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.600178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.601842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282bac6-7d4b-490f-bf98-02a1744a1bd1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.619288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa2849-aa9c-4413-8469-ae5b6de839cc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.620559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1036/2081] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:38.622088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.622426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.624790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.630302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.631079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.631411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.631993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] PATH_INFO: `/v3/users/318bcdff383345e1a6b32a52ff3658a6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.633650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318bcdff383345e1a6b32a52ff3658a6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.636166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.656876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:38.658113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.670113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1037/2082] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:38.671410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.683866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7041-85f6-4098-810e-80d7fe9b90d6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.690703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.691388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.691715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.692014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] PATH_INFO: `/v3/projects/bf95795754a040228bbf3ec7959db919/users/ab0b163bbe88485fbc04618ea6858ce1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.706458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318bcdff383345e1a6b32a52ff3658a6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.707542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318bcdff383345e1a6b32a52ff3658a6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.708037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95795754a040228bbf3ec7959db919, user_id=ab0b163bbe88485fbc04618ea6858ce1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.710737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.716719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318bcdff383345e1a6b32a52ff3658a6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.724983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318bcdff383345e1a6b32a52ff3658a6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.726294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318bcdff383345e1a6b32a52ff3658a6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:38.726668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1038/2083] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:38 2022] PUT /identity/v3/projects/bf95795754a040228bbf3ec7959db919/users/ab0b163bbe88485fbc04618ea6858ce1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:38.727573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.730961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.746402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1046/2084] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:38 2022] DELETE /identity/v3/users/318bcdff383345e1a6b32a52ff3658a6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:38.747261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.750800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.785933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.816513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f05e-d355-4d82-b7fe-82443dc9125b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.838238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba46f-a2d8-4631-89d7-79469635fe09 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.844102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.845188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.845925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.846464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.848857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.897411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:38.898097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:38.898336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:38.898595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] PATH_INFO: `/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:38.899776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfc1174e6bb4f79a1d4af889c371fff)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.901765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.938179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:38.939891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:38.953143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1047/2085] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:38.954177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:38.955784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:38.972169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b7bcc-e74b-42da-a86d-5600dc4480f7 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:38.976531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:38.994648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfc1174e6bb4f79a1d4af889c371fff', 'request_id': 'req-1787600d-8978-4519-ad9f-30f5c32e9087'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.004259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfc1174e6bb4f79a1d4af889c371fff', 'request_id': 'req-1787600d-8978-4519-ad9f-30f5c32e9087'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.012221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfc1174e6bb4f79a1d4af889c371fff', 'request_id': 'req-1787600d-8978-4519-ad9f-30f5c32e9087'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.035633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] The token cache is being invalidate because project 7bfc1174e6bb4f79a1d4af889c371fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:39.036020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.036912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1787600d-8978-4519-ad9f-30f5c32e9087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.043448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1039/2086] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:38 2022] DELETE /identity/v3/projects/7bfc1174e6bb4f79a1d4af889c371fff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:39.046556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f2-f94d-44a5-af77-f2ddb8d9fa6c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.046850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f2-f94d-44a5-af77-f2ddb8d9fa6c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.047130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79349f2-f94d-44a5-af77-f2ddb8d9fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.081396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.082509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.082863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.083188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.084081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.087305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.088000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b79349f2-f94d-44a5-af77-f2ddb8d9fa6c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.090882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b79349f2-f94d-44a5-af77-f2ddb8d9fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.109302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1040/2087] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.111228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1048/2088] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:39.114888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.114888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.114888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.123016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.140394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.141252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.157118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.157459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027ae7-aff1-46e5-be8a-79bd9555b984 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.162910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.163608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.163884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.164160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] PATH_INFO: `/v3/projects/bf95795754a040228bbf3ec7959db919/users/ab0b163bbe88485fbc04618ea6858ce1/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.167549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95795754a040228bbf3ec7959db919, user_id=ab0b163bbe88485fbc04618ea6858ce1, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.171315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.175474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1041/2089] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.175474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.175474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.192302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1049/2090] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:39 2022] PUT /identity/v3/projects/bf95795754a040228bbf3ec7959db919/users/ab0b163bbe88485fbc04618ea6858ce1/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:39.192302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.192608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b60b64-dd59-420e-ba33-2289afc9aa06 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.264249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.265194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.265719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.266163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] PATH_INFO: `/v3/projects/beea61b1d23f4ff985a110f51e310927` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.267482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beea61b1d23f4ff985a110f51e310927)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.270036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.276458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.284377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134abcb-2903-4361-b375-3444139acfc3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.291708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.292475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.292851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.293270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.294047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:39.294453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.296873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094f367-ca57-48f0-9ec3-e9535a0d63b8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.313306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1050/2091] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:39.314808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.315169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.315701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.338862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beea61b1d23f4ff985a110f51e310927', 'request_id': 'req-d6157da5-bb5b-4886-9527-00071933bc71'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.346130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beea61b1d23f4ff985a110f51e310927', 'request_id': 'req-d6157da5-bb5b-4886-9527-00071933bc71'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.347998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] MFA Rules not processed for user `ab0b163bbe88485fbc04618ea6858ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.349425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.352082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beea61b1d23f4ff985a110f51e310927', 'request_id': 'req-d6157da5-bb5b-4886-9527-00071933bc71'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.366125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] The token cache is being invalidate because project beea61b1d23f4ff985a110f51e310927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:39.366406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.367081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.368615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1042/2092] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:39 2022] DELETE /identity/v3/projects/beea61b1d23f4ff985a110f51e310927 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:39.374367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.374367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.421230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.432316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1051/2093] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.436886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.436886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.445577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6157da5-bb5b-4886-9527-00071933bc71 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.452345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.453030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.453311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.453591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] PATH_INFO: `/v3/projects/f7b6541a001c45e8a10b0f4b1f477c2e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.454531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5561b-8bb5-4f2e-9d90-d64b41b3d95e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.454946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b6541a001c45e8a10b0f4b1f477c2e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.456933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.459213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.459848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.460239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.460382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.461089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.463109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6816e-8026-46bd-92db-e59bda1d2962 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.498212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1052/2094] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:39.498212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.498212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.498212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.516358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b6541a001c45e8a10b0f4b1f477c2e', 'request_id': 'req-f13483bb-6de9-439e-af28-7ac1469eace5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.520380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.521642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.523082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b6541a001c45e8a10b0f4b1f477c2e', 'request_id': 'req-f13483bb-6de9-439e-af28-7ac1469eace5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.530674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b6541a001c45e8a10b0f4b1f477c2e', 'request_id': 'req-f13483bb-6de9-439e-af28-7ac1469eace5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.544054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] The token cache is being invalidate because project f7b6541a001c45e8a10b0f4b1f477c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:39.544341 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.545169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:39.546724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1043/2095] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:39 2022] DELETE /identity/v3/projects/f7b6541a001c45e8a10b0f4b1f477c2e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:39.550290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.550290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.605762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1053/2096] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.605762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.605762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.615914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6451-1bfb-4c68-8622-e6d0ef5eb570 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.621943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.622693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.623131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.623446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.624242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.626474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368ccb-12a6-4fd6-99cf-00ecb4d55469 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.630995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13483bb-6de9-439e-af28-7ac1469eace5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.638911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.639702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.640025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.640323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.643121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.664693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1054/2097] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/users => generated 300 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:39.666375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef76-9f5d-4537-8995-19f1e193eeec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.666761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef76-9f5d-4537-8995-19f1e193eeec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.667125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33ef76-9f5d-4537-8995-19f1e193eeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.695254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f33ef76-9f5d-4537-8995-19f1e193eeec None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.696697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f33ef76-9f5d-4537-8995-19f1e193eeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.706537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1055/2098] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.708354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.708354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.708590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.739780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.742248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.753944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1056/2099] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.754615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.766646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccffe73-fd8f-4e29-a7bb-611fa42a8c08 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.768823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.770631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206b395-a5b9-4037-a5d0-d74c90471828 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.775056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.775687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.775960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.776225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.776908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.781051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.786904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1044/2100] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:39.788080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.788642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.788945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.800415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1057/2101] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:39.801836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.817535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:39.818846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:39.820139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4817-c82e-475c-8b6e-e14af9b26c96 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.830431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571f44-2186-414a-b232-4e32763589db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.831176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f44-2186-414a-b232-4e32763589db admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.831546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f44-2186-414a-b232-4e32763589db admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.831923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f44-2186-414a-b232-4e32763589db admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.833226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571f44-2186-414a-b232-4e32763589db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:39.833869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571f44-2186-414a-b232-4e32763589db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.838092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571f44-2186-414a-b232-4e32763589db admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.845469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1045/2102] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:39.846312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.849314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.859279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1058/2103] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:39.860354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571f44-2186-414a-b232-4e32763589db admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.866364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87563e0-b58c-4d09-84fd-f02d9fc7c4e3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.874267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571f44-2186-414a-b232-4e32763589db admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.874530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.875222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.875622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.875891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.876641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.878732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.885545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.886491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.886682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.886951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.887627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:39.902246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.902246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.902538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1046/2104] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:39.902538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.902538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:39.908225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1059/2105] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:39.909674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.911106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c245-b6bb-401e-a68d-78cc63ff5dd5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.917661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.918429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.918933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.919233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.920006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.922243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.925075 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76918-d8fd-4204-893d-fa6c8a8b8072 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:39.930766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:39.931439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:39.931711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:39.931979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] PATH_INFO: `/v3/projects/3e4eea234c564ad8aca2dfa9400da120/users/25cf242f75424d7fab40ec5caadcb908/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:39.949635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4eea234c564ad8aca2dfa9400da120, user_id=25cf242f75424d7fab40ec5caadcb908, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:39.953112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:39.960839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1047/2106] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:39.960839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:39.980954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1060/2107] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:39 2022] PUT /identity/v3/projects/3e4eea234c564ad8aca2dfa9400da120/users/25cf242f75424d7fab40ec5caadcb908/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:39.980954 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.074257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627794d-b05b-47f2-80b7-cb50a8d8dd7f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.074984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df5c9-9099-4889-8cff-38622d9e88f1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.080224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.081054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.081425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.081821 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.081946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.082582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.082846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.082941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.083243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.083904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.085387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494dd78-4c23-48cd-a119-06fc90bf0c5e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.087575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.114766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1061/2108] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:40.118030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.118030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.118030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.125015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1048/2109] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:39 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:40.126366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.157203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] MFA Rules not processed for user `25cf242f75424d7fab40ec5caadcb908`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:40.158504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:40.225263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa182-a1fa-4174-a80f-5b9c3913d1a8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.233251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.234266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.234785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.235247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.236339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.239210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.252388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1062/2110] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:40.256576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1049/2111] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.256807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.257933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.270822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bde8c-cd0a-4e42-85e5-32f5512a57a4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.275928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.276792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.277419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.277419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.277971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.279181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d44663-b050-48b6-8cb0-c9229eff9b3f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.280199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.285547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.287006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.287493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.287876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.288863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.292576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.318515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1063/2112] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/users => generated 288 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:40.318515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.330043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab41f-9765-4f07-b0b8-af1df7dce3ae admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.336371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.337224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.337596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.337894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.338541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.340681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.353875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1050/2113] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:40.357910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1064/2114] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.358949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.359118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.371414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961ddb1-bed2-45ff-8200-2aa84636c8e5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.381467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:40.419711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:40.448299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.448955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.449293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.449855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.450124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdafec-7ef2-412c-96bc-26d78cef867f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.450756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.453078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.455789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.456481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.456882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.457223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.457984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.459671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.472289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1051/2115] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.472953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.485352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1065/2116] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/users => generated 307 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:40.486249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.489182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb13c-73e5-4af3-ba4d-499641a9ba1e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.496883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af24fc9-486e-4f68-b572-2380aad3bde7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.500337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.501288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.501762 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.502172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] PATH_INFO: `/v3/projects/389042dcd2c04217912d61e5bf2bd545/users/8416c998cbca4db493d4011d0be4d1f0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.505670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.507270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.507270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.507270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.507626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.509256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.522111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1066/2117] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.522981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.531791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=389042dcd2c04217912d61e5bf2bd545, user_id=8416c998cbca4db493d4011d0be4d1f0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.535080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.537527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec72b3d-ea17-43bf-9fe5-cc5365215149 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.543100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.544001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.544274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.544846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.545634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.548289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.561375 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1052/2118] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:40 2022] PUT /identity/v3/projects/389042dcd2c04217912d61e5bf2bd545/users/8416c998cbca4db493d4011d0be4d1f0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:40.562157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1067/2119] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.566043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.572139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.578529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afadcdd-a2cd-4b46-9848-9397cd5cf855 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.647768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8440-0b77-4ec8-af83-7afb34a4e63a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.649127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.650182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.650626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.651101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] PATH_INFO: `/v3/projects/70e4747ce3a8496fb43ae18de6db7020/users/216ae1b480b4490486ae637035c33dd0/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.653196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.654109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.654586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.655073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] PATH_INFO: `/v3/projects/df88f52ef92e420a98a0cb6ef0ba5f6a/users/72880e89da8c405c91ba627681267e8d/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.680094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=df88f52ef92e420a98a0cb6ef0ba5f6a, user_id=72880e89da8c405c91ba627681267e8d, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.682255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e4747ce3a8496fb43ae18de6db7020, user_id=216ae1b480b4490486ae637035c33dd0, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.683125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd614a4-f686-45e1-acef-98af94b274ef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.685214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.711706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1053/2120] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:40 2022] PUT /identity/v3/projects/df88f52ef92e420a98a0cb6ef0ba5f6a/users/72880e89da8c405c91ba627681267e8d/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:40.712062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1068/2121] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:40 2022] PUT /identity/v3/projects/70e4747ce3a8496fb43ae18de6db7020/users/216ae1b480b4490486ae637035c33dd0/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:40.713134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.713612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.714060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.714373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.717513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:40.747066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] MFA Rules not processed for user `8416c998cbca4db493d4011d0be4d1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:40.748550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:40.787739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc118ca6-3fa8-4671-b085-b94c6306549e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.793535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:40.818412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1054/2122] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:40.819300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.857023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:40.859370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.860107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.860385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.860655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] PATH_INFO: `/v3/users/2c95041f55424aa2ac1096399f2ed118` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.861865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c95041f55424aa2ac1096399f2ed118)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.864021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.895991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aca331-51e9-41ad-bc8b-9fe527bfb1e3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:40.901105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:40.901769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.902053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.902334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.902983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:40.905409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30adf5-051a-4787-9633-d52b5699dca0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:40.916207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1055/2123] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:40.920774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:40.921062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:40.921335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:40.929209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c95041f55424aa2ac1096399f2ed118'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:40.930375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c95041f55424aa2ac1096399f2ed118'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:40.939991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c95041f55424aa2ac1096399f2ed118'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:40.950102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c95041f55424aa2ac1096399f2ed118'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:40.950961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c95041f55424aa2ac1096399f2ed118'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:40.952271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] MFA Rules not processed for user `72880e89da8c405c91ba627681267e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:40.953664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:40.979560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1069/2124] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:40 2022] DELETE /identity/v3/users/2c95041f55424aa2ac1096399f2ed118 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:40.980538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:40.983337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.065397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1056/2125] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:41.066273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.067260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec405b81-88ec-45db-a783-0c0186d33c7b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.067800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.073292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.073925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.074182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.074449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.076609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.083097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407204a1-fc6d-4200-930e-d3df975620b2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.122774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.142995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.144456 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b3af4-c92e-48d6-a18c-6012d9893ce1 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.145308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.146002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.146275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.146550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] PATH_INFO: `/v3/projects/70e4747ce3a8496fb43ae18de6db7020/users/216ae1b480b4490486ae637035c33dd0/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.148469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e4747ce3a8496fb43ae18de6db7020, user_id=216ae1b480b4490486ae637035c33dd0, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.151369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.154082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1070/2126] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:41.155416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369642-f4dc-48d8-a99f-7e4f93669fe4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.155785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369642-f4dc-48d8-a99f-7e4f93669fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.155955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369642-f4dc-48d8-a99f-7e4f93669fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.167564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1057/2127] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:41 2022] PUT /identity/v3/projects/70e4747ce3a8496fb43ae18de6db7020/users/216ae1b480b4490486ae637035c33dd0/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:41.168527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.178476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ba369642-f4dc-48d8-a99f-7e4f93669fe4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:41.179805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ba369642-f4dc-48d8-a99f-7e4f93669fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.180445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.249888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1071/2128] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:41.254177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.254347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.254636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.254902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.274934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65fa57-24d0-4f8d-be02-b435a4648627 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.281163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.281782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.282063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.282340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.283010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.284994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.290183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] MFA Rules not processed for user `216ae1b480b4490486ae637035c33dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:41.291572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.331736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1058/2129] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:41 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:41.332737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.334666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.392694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1072/2130] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:41.393686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.408452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59e791-38cd-4e23-bd04-302d728c941f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.409940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c10f-9629-49b6-ad05-b75dbf322d1c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.413475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.414417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.414868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.415210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.486964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.487733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.488215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.488397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.488995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.490969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.502018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.503626 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.510871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.516278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1059/2131] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:41.517207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.518860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:41.523230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1073/2132] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:41 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:41.524251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.536904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d12b1-7dc4-4804-9cc9-8e449640066b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.542468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.543611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.543754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.544025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.544878 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.547244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.569551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1074/2133] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:41.570787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.586803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30892730-ab70-4a81-a4ed-6e9b9a6a8698 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.593659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d77ba-2155-4a4a-b2d5-a2ad25d9a094 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.593920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.594970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.595248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.595601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] PATH_INFO: `/v3/projects/426b4947dd4c4c9699002d39f2dc0c48/users/96f5a0c5eb0f4696aab5797b53902571/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.599390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.600434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.601078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.601552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.622349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=426b4947dd4c4c9699002d39f2dc0c48, user_id=96f5a0c5eb0f4696aab5797b53902571, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.626688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.645897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1075/2134] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:41 2022] PUT /identity/v3/projects/426b4947dd4c4c9699002d39f2dc0c48/users/96f5a0c5eb0f4696aab5797b53902571/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:41.664725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.689301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:41.801257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.803973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.820255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1060/2135] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:41.848546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5680a1-8039-4c86-b159-589bf92ce0dd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.853351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.854032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.854332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.854599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.855252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.857497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0043-52ac-4516-b243-a4f161b5f33d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.872484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1076/2136] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:41.875859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.887818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b4ac-7cd1-4dab-8313-74ae69780a95 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:41.893236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:41.894171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.894447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.894719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] PATH_INFO: `/v3/projects/426b4947dd4c4c9699002d39f2dc0c48/users/96f5a0c5eb0f4696aab5797b53902571/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.898977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426b4947dd4c4c9699002d39f2dc0c48, user_id=96f5a0c5eb0f4696aab5797b53902571, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:41.900100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:41.916084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1061/2137] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:41 2022] PUT /identity/v3/projects/426b4947dd4c4c9699002d39f2dc0c48/users/96f5a0c5eb0f4696aab5797b53902571/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:41.924541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:41.924849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:41.925128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:41.927090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:41.964433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] MFA Rules not processed for user `96f5a0c5eb0f4696aab5797b53902571`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:41.965985 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.004116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83035-1e25-4acb-ae81-0d38a6851467 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:42.007706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:42.008348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.008595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.008890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.010641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.070368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1077/2138] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:42.071255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:42.072674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.097061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:42.098795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:42.116712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1062/2139] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:42.117763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:42.119871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:42.132703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a088eb-8e5f-45d4-b4b1-634c8ec19398 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:42.136479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:42.137264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.137542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.137870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.154273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:42.179540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c649e9d-42c5-4d9a-a1a4-ec6a1b46ce97 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:42.188479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:42.188479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.188479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.188479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] PATH_INFO: `/v3/projects/be8d18c5c891416bbbfe7152f7a46e80` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.189265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8d18c5c891416bbbfe7152f7a46e80)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:42.191206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:42.205276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:42.208314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:42.224258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1063/2140] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:42.280376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8d18c5c891416bbbfe7152f7a46e80', 'request_id': 'req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.295117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8d18c5c891416bbbfe7152f7a46e80', 'request_id': 'req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.317497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8d18c5c891416bbbfe7152f7a46e80', 'request_id': 'req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.346461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] The token cache is being invalidate because project be8d18c5c891416bbbfe7152f7a46e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:42.346865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.347377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.350221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1078/2141] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:42 2022] DELETE /identity/v3/projects/be8d18c5c891416bbbfe7152f7a46e80 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:42.355054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:42.371879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa1c6b-4139-4b99-bcf8-54defee1fbd6 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:42.398841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:42.487435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:42.488120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:42.488424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:42.488695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] PATH_INFO: `/v3/users/ab0b163bbe88485fbc04618ea6858ce1` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:42.490290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0b163bbe88485fbc04618ea6858ce1)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:42.492484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:42.598829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0b163bbe88485fbc04618ea6858ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.611429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0b163bbe88485fbc04618ea6858ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.631152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0b163bbe88485fbc04618ea6858ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.632164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0b163bbe88485fbc04618ea6858ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.633621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf1ddf22-de15-405f-bfd4-8e525309d77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0b163bbe88485fbc04618ea6858ce1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:42.654579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1064/2142] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:42 2022] DELETE /identity/v3/users/ab0b163bbe88485fbc04618ea6858ce1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:43.257241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.261020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:43.288187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f945b-ad8d-42eb-9ac6-fbba4e5f4185 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.375295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.376107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.376107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.376398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] PATH_INFO: `/v3/projects/bf95795754a040228bbf3ec7959db919` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.377722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf95795754a040228bbf3ec7959db919)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.379749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.456516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf95795754a040228bbf3ec7959db919', 'request_id': 'req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:43.463401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf95795754a040228bbf3ec7959db919', 'request_id': 'req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:43.472325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf95795754a040228bbf3ec7959db919', 'request_id': 'req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:43.490037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] The token cache is being invalidate because project bf95795754a040228bbf3ec7959db919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:43.490330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:43.490998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef9c43fc-2bbc-49c5-a81c-d599e9a1df09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:43.492724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1079/2143] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:43 2022] DELETE /identity/v3/projects/bf95795754a040228bbf3ec7959db919 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:43.500213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.500861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.500861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.524156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:43.525587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:43.600367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1065/2144] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:43.610060 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.610404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.610677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.619432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:43.633302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:43.635501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:43.644151 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1080/2145] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:43.648575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.658643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0547e-a75d-4594-9357-d7eb2816c01b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.668001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.668715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.669065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.669498 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.670209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:43.670543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.672283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.686216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1066/2146] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:43.690903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.701560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97d50f-5acd-4dd7-8985-ed1e2205dffe None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.713542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.714300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.714786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.715014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.715798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.719221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.751324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1081/2147] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:43.755651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.766949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945383ca-5490-427d-87bc-bc69beea0505 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.787255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:43.886128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.887091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.887517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.888298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.889663 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.892534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.917926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1067/2148] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:43 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:43.922649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.936888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb700748-59b0-456d-800f-853356cfb7fe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.942569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.943322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.943700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.944111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.944860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.947032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:43.963408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1082/2149] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:43.970035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:43.982495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c839-b160-4ec6-baf4-255ac7d27612 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:43.989350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:43.990124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:43.990483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:43.990883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:43.991687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:43.993462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d38c5-a6ff-4ef4-ac7d-45b515968ed1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:44.014433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1068/2150] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:44.016827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:44.034723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333ad5f-4f8b-48e2-9a77-9c05eb9dc98e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:44.050768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:44.051590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:44.055512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:44.055512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] PATH_INFO: `/v3/projects/ecb91b88f3ab401c9ff9ddb2b254b9ca/users/9c19c666143743c5bd2e27ccfd6f6daa/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:44.080516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb91b88f3ab401c9ff9ddb2b254b9ca, user_id=9c19c666143743c5bd2e27ccfd6f6daa, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:44.083711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:44.111248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1083/2151] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:44 2022] PUT /identity/v3/projects/ecb91b88f3ab401c9ff9ddb2b254b9ca/users/9c19c666143743c5bd2e27ccfd6f6daa/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:44.121665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:44.121883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:44.122051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:44.156934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] MFA Rules not processed for user `9c19c666143743c5bd2e27ccfd6f6daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:44.158168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:44.225725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1069/2152] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:44.237732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:44.240126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:44.309201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b09e1-49c4-4b7f-8261-6426847b336f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:44.314722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:44.315349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:44.315626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:44.315895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:44.327140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:44.328609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:44.342079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1084/2153] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:45.180812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:45.191133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605cbe-fd95-41e6-974a-15d0ac3129aa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:45.195032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:45.195652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:45.196007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:45.196207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:45.198778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:45.275705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:45.277629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743340-b176-4e34-b472-e88eda743200 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:45.289225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1070/2154] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:46.667886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:46.669618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:46.767369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390292a-3ce6-4c0e-92b1-703029af969e service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:46.774548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:46.775423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:46.775877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:46.776313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] PATH_INFO: `/v3/users/25cf242f75424d7fab40ec5caadcb908` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:46.778157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cf242f75424d7fab40ec5caadcb908)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:46.781435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:46.846211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:46.848717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cf242f75424d7fab40ec5caadcb908'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:46.850168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cf242f75424d7fab40ec5caadcb908'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:46.861191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cf242f75424d7fab40ec5caadcb908'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:46.870944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cf242f75424d7fab40ec5caadcb908'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:46.871618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cf242f75424d7fab40ec5caadcb908'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:46.901197 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1085/2155] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:46 2022] DELETE /identity/v3/users/25cf242f75424d7fab40ec5caadcb908 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:46.905936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:46.906807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:46.907260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:46.927246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:46.928469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:46.941969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:47.000907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1071/2156] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:47.014210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:47.016418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:47.114035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3286b0-38b6-4c4a-baf5-769dbd75feed admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:47.119245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183252f6-c47d-473b-a170-775476041489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:47.120007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183252f6-c47d-473b-a170-775476041489 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:47.120317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183252f6-c47d-473b-a170-775476041489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:47.120675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183252f6-c47d-473b-a170-775476041489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:47.132177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183252f6-c47d-473b-a170-775476041489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:47.133924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183252f6-c47d-473b-a170-775476041489 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:47.148291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1086/2157] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:47.461885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:47.463405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:47.479894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2346c-d088-46d9-963a-5166b8e5793d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:47.488153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:47.488844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:47.489363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:47.489574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] PATH_INFO: `/v3/projects/3e4eea234c564ad8aca2dfa9400da120` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:47.491025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4eea234c564ad8aca2dfa9400da120)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:47.493414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:47.548540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4eea234c564ad8aca2dfa9400da120', 'request_id': 'req-a88ab928-76d3-43c4-88d4-824b234588be'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.554815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4eea234c564ad8aca2dfa9400da120', 'request_id': 'req-a88ab928-76d3-43c4-88d4-824b234588be'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.560522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4eea234c564ad8aca2dfa9400da120', 'request_id': 'req-a88ab928-76d3-43c4-88d4-824b234588be'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.576148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] The token cache is being invalidate because project 3e4eea234c564ad8aca2dfa9400da120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:47.576502 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.577524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.579204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1072/2158] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:47 2022] DELETE /identity/v3/projects/3e4eea234c564ad8aca2dfa9400da120 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:47.583448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183252f6-c47d-473b-a170-775476041489 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:47.596083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183252f6-c47d-473b-a170-775476041489 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:47.657512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:47.658146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:47.658418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:47.658688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] PATH_INFO: `/v3/users/216ae1b480b4490486ae637035c33dd0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:47.659840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=216ae1b480b4490486ae637035c33dd0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:47.661823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:47.712147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216ae1b480b4490486ae637035c33dd0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.712897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216ae1b480b4490486ae637035c33dd0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.720917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216ae1b480b4490486ae637035c33dd0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.728438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216ae1b480b4490486ae637035c33dd0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.729235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9c38358-b598-441f-afb4-e5935ec7b054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216ae1b480b4490486ae637035c33dd0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:47.734609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:47.751257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1087/2159] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:47 2022] DELETE /identity/v3/users/216ae1b480b4490486ae637035c33dd0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:48.059665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.063189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.080106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ab928-76d3-43c4-88d4-824b234588be admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.148221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.148906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.149183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.149457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] PATH_INFO: `/v3/projects/70e4747ce3a8496fb43ae18de6db7020` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.151065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e4747ce3a8496fb43ae18de6db7020)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.153713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.234396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:48.239039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e4747ce3a8496fb43ae18de6db7020', 'request_id': 'req-a28362b4-f595-4023-a544-788aaf3b99c2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:48.249139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e4747ce3a8496fb43ae18de6db7020', 'request_id': 'req-a28362b4-f595-4023-a544-788aaf3b99c2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:48.256792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e4747ce3a8496fb43ae18de6db7020', 'request_id': 'req-a28362b4-f595-4023-a544-788aaf3b99c2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:48.293834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] The token cache is being invalidate because project 70e4747ce3a8496fb43ae18de6db7020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:48.294378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:48.295765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a28362b4-f595-4023-a544-788aaf3b99c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:48.297912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1073/2160] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:48 2022] DELETE /identity/v3/projects/70e4747ce3a8496fb43ae18de6db7020 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:48.304308 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.305868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.306485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.336500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:48.338124 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.449879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1088/2161] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:48.458775 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.459131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.459589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.480797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:48.482702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.490941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1074/2162] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:48.495398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.506648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261a730-7ffc-4d4b-8815-c9a90145609f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.512288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.513025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.513370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.513596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.514287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:48.514599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.516222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.529560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1089/2163] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:15:48.534493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.544247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301fa87-365e-41b0-8b15-5f4a3cd251dd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.549312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.549924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.550207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.550480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.551116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.553158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.588322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1075/2164] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:48.593035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.603893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0b07-d010-4f21-af83-8e676ac7cb15 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.671720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.672361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.672632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.672963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.673598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.675507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.698981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1090/2165] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:48.703439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.715167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5dcf2-9d38-4142-b550-889fbcc69ffc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.726185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.726815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.727088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.727355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.728010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.730238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.741792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1076/2166] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:48.746121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.756909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca6bcc-fbbe-4e7e-8185-cf7d5cfb3150 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.761648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.762251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.762515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.762776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.763792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.765419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e36f27-0dab-478a-8a88-e81f7bb1c1f9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.777299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1091/2167] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:48.782052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.793609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93baf0f-319e-4c89-8ea0-e02688f7aabd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:48.798444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:48.799105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.799379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.799644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] PATH_INFO: `/v3/projects/7d4b78b5754042bfb4a51e9b50e5e24e/users/f062d87e5ab84dff99ffcaaa730efd41/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.815747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4b78b5754042bfb4a51e9b50e5e24e, user_id=f062d87e5ab84dff99ffcaaa730efd41, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:48.818456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:48.833114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1077/2168] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:48 2022] PUT /identity/v3/projects/7d4b78b5754042bfb4a51e9b50e5e24e/users/f062d87e5ab84dff99ffcaaa730efd41/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:48.839049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b637d3-ac92-4305-b358-e4af2224e0a5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:48.839471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b637d3-ac92-4305-b358-e4af2224e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:48.839707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b637d3-ac92-4305-b358-e4af2224e0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:48.867263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-97b637d3-ac92-4305-b358-e4af2224e0a5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:48.868501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-97b637d3-ac92-4305-b358-e4af2224e0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:48.920037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:48.938400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1092/2169] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:48.949081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:48.950913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:49.020994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c9966-66af-4dde-814b-362ee27d9d2c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:49.024556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:49.025232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:49.025479 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:49.025738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:49.037020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:49.039074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:49.050428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1078/2170] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:49.816489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd74-6f9c-44f7-a145-63dc6b790b64 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:49.817121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd74-6f9c-44f7-a145-63dc6b790b64 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:49.817121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91dd74-6f9c-44f7-a145-63dc6b790b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:49.856684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f91dd74-6f9c-44f7-a145-63dc6b790b64 None None] MFA Rules not processed for user `f062d87e5ab84dff99ffcaaa730efd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:49.858433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f91dd74-6f9c-44f7-a145-63dc6b790b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:49.962343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1093/2171] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:49.975301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:49.977388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:50.044319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ffb70-35f0-425b-b430-cb2b40b5b229 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:50.048766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:50.049384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:50.049661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:50.049926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:50.058658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:50.060222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:50.069279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1079/2172] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:51.501737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcae6c-dd15-4ba4-8d27-77841d3359e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:51.502192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcae6c-dd15-4ba4-8d27-77841d3359e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:51.502192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcae6c-dd15-4ba4-8d27-77841d3359e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:51.521439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-59dcae6c-dd15-4ba4-8d27-77841d3359e3 None None] MFA Rules not processed for user `f062d87e5ab84dff99ffcaaa730efd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:51.522653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-59dcae6c-dd15-4ba4-8d27-77841d3359e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:51.529866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1094/2173] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:57.441758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:57.444000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:57.462340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665cf4f-c93b-4e31-bc53-26151064b224 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:57.468005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:57.468771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:57.469049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:57.469326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] PATH_INFO: `/v3/users/9c19c666143743c5bd2e27ccfd6f6daa` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:57.471784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c19c666143743c5bd2e27ccfd6f6daa)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:57.472560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:57.486093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:57.532122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c19c666143743c5bd2e27ccfd6f6daa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:57.539360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c19c666143743c5bd2e27ccfd6f6daa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:57.554844 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c19c666143743c5bd2e27ccfd6f6daa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:57.555632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c19c666143743c5bd2e27ccfd6f6daa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:57.556277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c19c666143743c5bd2e27ccfd6f6daa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:57.571751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1080/2174] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:57 2022] DELETE /identity/v3/users/9c19c666143743c5bd2e27ccfd6f6daa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:57.577501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:57.578793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:57.579272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:57.611944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:57.614043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:57.699910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1095/2175] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:57.710506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:57.712134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:57.784615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277598c-088a-4270-a597-9fcb4e64a633 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:57.788456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:57.789096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:57.789371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:57.789646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:57.800167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:57.801790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:57.812621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1081/2176] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:15:58.308427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.310360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.331182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301782b5-38c8-47bc-843b-343c89a50272 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.338692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.339660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.340160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.340468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] PATH_INFO: `/v3/projects/ecb91b88f3ab401c9ff9ddb2b254b9ca` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.342576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb91b88f3ab401c9ff9ddb2b254b9ca)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.346479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.437496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb91b88f3ab401c9ff9ddb2b254b9ca', 'request_id': 'req-ccef7b5d-7377-4486-9b03-f9fae851d478'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.446583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.448205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.453612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb91b88f3ab401c9ff9ddb2b254b9ca', 'request_id': 'req-ccef7b5d-7377-4486-9b03-f9fae851d478'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.461254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb91b88f3ab401c9ff9ddb2b254b9ca', 'request_id': 'req-ccef7b5d-7377-4486-9b03-f9fae851d478'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.463505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42f865-88e2-4361-92f3-99710fa942e2 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.472683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:58.479480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] The token cache is being invalidate because project ecb91b88f3ab401c9ff9ddb2b254b9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:58.479835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.483440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ccef7b5d-7377-4486-9b03-f9fae851d478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.488597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1096/2177] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:58 2022] DELETE /identity/v3/projects/ecb91b88f3ab401c9ff9ddb2b254b9ca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:58.490065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd33f-dd96-48c5-953a-b9bb9ac3be4b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.490345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd33f-dd96-48c5-953a-b9bb9ac3be4b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.490614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfd33f-dd96-48c5-953a-b9bb9ac3be4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.518356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-79cfd33f-dd96-48c5-953a-b9bb9ac3be4b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:58.520397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-79cfd33f-dd96-48c5-953a-b9bb9ac3be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.538194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.538832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.539112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.539447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] PATH_INFO: `/v3/users/72880e89da8c405c91ba627681267e8d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.540555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=72880e89da8c405c91ba627681267e8d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.542535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.581818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:58.597766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72880e89da8c405c91ba627681267e8d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.604884 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72880e89da8c405c91ba627681267e8d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.618308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72880e89da8c405c91ba627681267e8d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.619137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72880e89da8c405c91ba627681267e8d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.619760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fbffce7-ec97-461a-ba18-e769cb37dbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72880e89da8c405c91ba627681267e8d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:58.630517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1097/2178] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:58.643758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1082/2179] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:58 2022] DELETE /identity/v3/users/72880e89da8c405c91ba627681267e8d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:58.647379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.647554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.647861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.648032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.648283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.648442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.672583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:58.674166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.681909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:58.683071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.771359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1098/2180] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:58.771666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1083/2181] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:15:58.772622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.783359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3651d-5e6c-461c-a661-cd0d68715129 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.784450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.786295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:58.790103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.790828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.791103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.791369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.792013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:15:58.792311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.794132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.811996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1099/2182] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:15:58.816321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.827465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe41a-f877-4364-9183-7b7516002874 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.832340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.832927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.833196 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.833460 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.834093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.835971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.859895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80bf74-f3ea-44f1-a81a-ab33ff369b2d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.863804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.864412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.864685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.864985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.871327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1100/2183] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:58 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:58.876086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:58.877132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.878590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.888718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1084/2184] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:15:58.949068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d2bb5-d87e-44ff-bb55-f2ceaf5663af admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:58.955966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:58.956834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:58.957557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:58.957557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:58.958255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:58.961015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:58.973862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:58.989833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1101/2185] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:58 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:58.994266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.009047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43e51-161a-45e1-b4fa-4108824df001 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.016544 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.018422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.019219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.019219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.019913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.022304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.036159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1085/2186] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:59.046011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.058477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31535e31-62f5-4d2c-b794-9d6c96049083 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.064389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.065069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.065364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.065861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.066527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.069085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25baae0-246b-4f32-8842-0902765c07a2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.084018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1102/2187] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:15:59.088149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.110047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc78ca5-234d-4ea6-81a0-4f7d604fca44 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.115597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.116332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.116648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.116959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] PATH_INFO: `/v3/projects/68906eede8d8424e82b26304a822b41d/users/104d88b43262457f84d444f86e3c658c/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.140629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] RBAC: Authorizing `identity:create_grant(project_id=68906eede8d8424e82b26304a822b41d, user_id=104d88b43262457f84d444f86e3c658c, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.143864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.158468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1086/2188] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:59 2022] PUT /identity/v3/projects/68906eede8d8424e82b26304a822b41d/users/104d88b43262457f84d444f86e3c658c/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:59.168707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e57-5301-460c-af47-9728f664818e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.169082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e57-5301-460c-af47-9728f664818e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.169351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e57-5301-460c-af47-9728f664818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.201820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-92112e57-5301-460c-af47-9728f664818e None None] MFA Rules not processed for user `104d88b43262457f84d444f86e3c658c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:59.203499 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-92112e57-5301-460c-af47-9728f664818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.212074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.214179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.245177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:59.289676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1103/2189] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:59.294630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92112e57-5301-460c-af47-9728f664818e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.305703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92112e57-5301-460c-af47-9728f664818e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.312018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.312789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.313102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.313464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.314027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bc7f7-b000-4e4a-b8fe-4b268d93acef admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.314293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.316645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.328961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.329621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.329939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.330168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] PATH_INFO: `/v3/projects/df88f52ef92e420a98a0cb6ef0ba5f6a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.331420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] RBAC: Authorizing `identity:delete_project(project_id=df88f52ef92e420a98a0cb6ef0ba5f6a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.333417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.348941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1104/2190] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:59 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:15:59.353195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.406299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df88f52ef92e420a98a0cb6ef0ba5f6a', 'request_id': 'req-5bfe1245-053f-4793-ba33-a34cc3d1fcca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.416460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df88f52ef92e420a98a0cb6ef0ba5f6a', 'request_id': 'req-5bfe1245-053f-4793-ba33-a34cc3d1fcca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.423923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df88f52ef92e420a98a0cb6ef0ba5f6a', 'request_id': 'req-5bfe1245-053f-4793-ba33-a34cc3d1fcca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.439554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] The token cache is being invalidate because project df88f52ef92e420a98a0cb6ef0ba5f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:15:59.439843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.440692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.442262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1087/2191] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:15:59 2022] DELETE /identity/v3/projects/df88f52ef92e420a98a0cb6ef0ba5f6a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:59.443285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5e631-bbf3-46da-8a43-defc9ccec0f9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.446216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.447836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.549489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:59.558786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe1245-053f-4793-ba33-a34cc3d1fcca admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.559149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.561285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.561782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.562318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.563420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.565836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.566246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.566800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.567176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.567536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] PATH_INFO: `/v3/users/96f5a0c5eb0f4696aab5797b53902571` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.568959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f5a0c5eb0f4696aab5797b53902571)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.571337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.597721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1105/2192] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:15:59 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:15:59.602739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.604643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.622870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084f119-ef03-4795-a18b-d2be455602e6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.630679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.631732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.632241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.632623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.633566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.635405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.646361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f5a0c5eb0f4696aab5797b53902571'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.647180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1106/2193] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:59.649340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:15:59.651169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.660655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f5a0c5eb0f4696aab5797b53902571'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.663033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224d8d-c3d9-4ab4-9315-23b688a8f3ab admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.668961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.669609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.669996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.670265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.670919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.672599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.682456 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f5a0c5eb0f4696aab5797b53902571'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.683259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f5a0c5eb0f4696aab5797b53902571'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.683906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5abb7ce-2f09-4950-b351-0aa137430d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f5a0c5eb0f4696aab5797b53902571'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:15:59.686092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1107/2194] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:15:59.692066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:15:59.694650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.702766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1088/2195] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:15:59 2022] DELETE /identity/v3/users/96f5a0c5eb0f4696aab5797b53902571 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:15:59.710875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a755-5cc9-4333-96bb-ab87bed96165 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:15:59.790392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:15:59.791057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.791465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.791814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] PATH_INFO: `/v3/projects/bbf59983b1e9409d809ce21d5b710a39/users/99ce3dcaa0d8416f9f9afc12ff87372b/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.809262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf59983b1e9409d809ce21d5b710a39, user_id=99ce3dcaa0d8416f9f9afc12ff87372b, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:15:59.812673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:15:59.834793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1108/2196] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:15:59 2022] PUT /identity/v3/projects/bbf59983b1e9409d809ce21d5b710a39/users/99ce3dcaa0d8416f9f9afc12ff87372b/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:15:59.846573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:15:59.847080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:15:59.847446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:15:59.881357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] MFA Rules not processed for user `99ce3dcaa0d8416f9f9afc12ff87372b`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:15:59.882589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:15:59.973082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1089/2197] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:15:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:15:59.978130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.027298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.029518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.065956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b14b-1a6c-4b9d-af4b-32233832aded admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.072448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.073252 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.073628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.073995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.074779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.077216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.107239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1109/2198] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:15:59 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:00.112213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.127439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc95b7-54ad-4d21-b718-d662b6557da6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.166451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:00.197945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.198683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.198958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.199223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] PATH_INFO: `/v3/projects/426b4947dd4c4c9699002d39f2dc0c48` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.200530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426b4947dd4c4c9699002d39f2dc0c48)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.202729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.203317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a3669-66eb-465d-a341-bcb065c5944f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.208051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.208664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.208965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.209255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.209649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:00.209859 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.211935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.239258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1110/2199] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:00.243407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.254244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5063-40eb-4b71-ba32-d5037bd43051 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.274089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426b4947dd4c4c9699002d39f2dc0c48', 'request_id': 'req-f167c2f8-5f10-4ac2-8584-bef128bbea70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:00.281745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426b4947dd4c4c9699002d39f2dc0c48', 'request_id': 'req-f167c2f8-5f10-4ac2-8584-bef128bbea70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:00.288615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426b4947dd4c4c9699002d39f2dc0c48', 'request_id': 'req-f167c2f8-5f10-4ac2-8584-bef128bbea70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:00.306315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] The token cache is being invalidate because project 426b4947dd4c4c9699002d39f2dc0c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:00.307051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:00.307547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f167c2f8-5f10-4ac2-8584-bef128bbea70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:00.309744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1090/2200] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:00 2022] DELETE /identity/v3/projects/426b4947dd4c4c9699002d39f2dc0c48 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:00.318529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c900-c222-4726-af88-c8eb3123dfba None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.318845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c900-c222-4726-af88-c8eb3123dfba None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.319118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c900-c222-4726-af88-c8eb3123dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.331626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.332250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.332524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.332815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.333518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.335096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.344190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a076c900-c222-4726-af88-c8eb3123dfba None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:00.345554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a076c900-c222-4726-af88-c8eb3123dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.347945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1111/2201] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:00.351992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.353704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.359683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1091/2202] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:00.368111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.368394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.368681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.369355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c3886-27f2-4075-9086-65acc60c09c9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.375174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.375844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.376114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.376378 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] PATH_INFO: `/v3/projects/bc5869ef3a5e41fcaa6b311472250130/users/ba3505e1f3524e68bacb691e53ce6a3a/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.390935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:00.392191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.397253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5869ef3a5e41fcaa6b311472250130, user_id=ba3505e1f3524e68bacb691e53ce6a3a, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.399929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.401414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1092/2203] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:00.408601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.419019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b975d-461c-4736-984a-db10d92a864c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.419833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1112/2204] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:00 2022] PUT /identity/v3/projects/bc5869ef3a5e41fcaa6b311472250130/users/ba3505e1f3524e68bacb691e53ce6a3a/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:00.424644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.484508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.485182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.485415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.485686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.486338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:00.486640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.488247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.496782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34220-828c-4226-99f8-b614097aeccb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.502889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.503062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1093/2205] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:00.503325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.503606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.504036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.504530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.506295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.508118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.518669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1113/2206] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:00.519368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2e8c1-4fa4-4da6-95ae-ff845b747eff admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.523350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.524303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.524970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.525246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.525514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.526149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.528052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.540776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9640-794d-462c-93bc-df32c13d21d0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.546964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.547684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.547974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.548226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] PATH_INFO: `/v3/projects/bc5869ef3a5e41fcaa6b311472250130/users/ba3505e1f3524e68bacb691e53ce6a3a/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.551657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5869ef3a5e41fcaa6b311472250130, user_id=ba3505e1f3524e68bacb691e53ce6a3a, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.554940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f4497-ff47-440c-b0a5-b1b3d4f278a5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.562528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1094/2207] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:00.566940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.579667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1114/2208] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:00 2022] PUT /identity/v3/projects/bc5869ef3a5e41fcaa6b311472250130/users/ba3505e1f3524e68bacb691e53ce6a3a/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:00.643343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e8010-ce61-4d96-a416-a713b449992b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.644112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e8010-ce61-4d96-a416-a713b449992b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.644112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e8010-ce61-4d96-a416-a713b449992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.656898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:00.676120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e33ce8-ff09-4432-8609-dbbc6c92edf1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.690012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-250e8010-ce61-4d96-a416-a713b449992b None None] MFA Rules not processed for user `ba3505e1f3524e68bacb691e53ce6a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:00.690613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-250e8010-ce61-4d96-a416-a713b449992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.696298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:00.752252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.752976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.753235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.753552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.754232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.756453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.777389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1115/2209] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:00.781032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1095/2210] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:00.784686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e8010-ce61-4d96-a416-a713b449992b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.789940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.791714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.795838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e8010-ce61-4d96-a416-a713b449992b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.801080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.801809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.801949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.802203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.802881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.804459 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.815622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1116/2211] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:00.821962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.839565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab352-2cc9-4253-8752-7acd2591ad61 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.845835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.846345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.846774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.847106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.847723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.849408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.864913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1117/2212] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:00.866357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:00.877073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fbe8c-a368-4f61-9bc1-2ef73a33e2e2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.880178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b30f0-a308-4b69-8fe9-3edeaa9f25e8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:00.882029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.882693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.882991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.883237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] PATH_INFO: `/v3/projects/4b7eaf2413284944822109a85e133edc/users/e42f53e3f2894fd8b39ef954485a266e/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.884000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:00.884842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.885127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.885393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.887223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.901125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaf2413284944822109a85e133edc, user_id=e42f53e3f2894fd8b39ef954485a266e, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.904123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d59ee-146d-49ad-be53-e3d1b80cb1b3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.920808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1118/2213] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:00 2022] PUT /identity/v3/projects/4b7eaf2413284944822109a85e133edc/users/e42f53e3f2894fd8b39ef954485a266e/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:00.931523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:00.931836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:00.932107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:00.964241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:00.967226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:00.968501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] MFA Rules not processed for user `e42f53e3f2894fd8b39ef954485a266e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:00.969936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:00.981285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1096/2214] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:01.076946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1119/2215] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:01.079369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.094604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07d25-c419-453e-9f68-d5d75929ecde service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.181290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:01.217130 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.219595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.220400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.220400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.222043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.225636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.261823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1097/2216] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:01 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:01.266765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.292823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9083a-00f1-4599-9f04-3815684cd72c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.347027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:01.367188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.368102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.368472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.370301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.370301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.372638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.413637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1120/2217] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:01 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:01.417392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.433605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752137-c578-4ec9-89ab-424b2e2cc5f6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.444828 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.445527 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.446017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.446476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.447235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.449106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.468808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1098/2218] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:01.470833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.485445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62820-d551-4b31-85c7-048bf0a88074 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.490733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.491540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.491895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.492223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] PATH_INFO: `/v3/projects/4932a574c3064fb7897f33163fb46c4f/users/e01f63648e3e4d29bf1edbdf8d15b3e7/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.513299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4932a574c3064fb7897f33163fb46c4f, user_id=e01f63648e3e4d29bf1edbdf8d15b3e7, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.516316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.538933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1121/2219] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:01 2022] PUT /identity/v3/projects/4932a574c3064fb7897f33163fb46c4f/users/e01f63648e3e4d29bf1edbdf8d15b3e7/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:01.544815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.555661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec1d6a-bb9e-450a-aea1-dd161dc662dd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.623372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.623992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.624281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.624534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.625420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.627805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf4b51-943c-4ca9-919b-1c4252352547 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.641753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1099/2220] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:01.647278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.664258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfc52a-7fd3-44a3-975c-8183e9c3b046 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.676670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.677813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.677813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.678254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] PATH_INFO: `/v3/projects/4932a574c3064fb7897f33163fb46c4f/users/e01f63648e3e4d29bf1edbdf8d15b3e7/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.681166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4932a574c3064fb7897f33163fb46c4f, user_id=e01f63648e3e4d29bf1edbdf8d15b3e7, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:01.684968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:01.698774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1122/2221] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:01 2022] PUT /identity/v3/projects/4932a574c3064fb7897f33163fb46c4f/users/e01f63648e3e4d29bf1edbdf8d15b3e7/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:01.711428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.711644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.712055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:01.752183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] MFA Rules not processed for user `e01f63648e3e4d29bf1edbdf8d15b3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:01.755160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:01.852787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1100/2222] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:01.865473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:01.955100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099f32-da8f-4f5a-8a8d-593137f77da6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:01.961607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:01.962866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:01.963394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:01.963976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:02.053742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:02.055475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:02.067025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1123/2223] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:02.724447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:02.734559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b39d9-6411-4e84-9115-238d984bfb74 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:02.738129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:02.738899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:02.739068 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:02.739345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:02.741114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:02.786004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:02.812486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:02.814329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:02.824674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1101/2224] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:03.537822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:03.551276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56100c3-1811-4788-a681-277cc030152c service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:03.556605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:03.558074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:03.558074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:03.558074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:03.573280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:03.575145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:03.588572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac584-e71c-45db-a062-5ab1e51e07d2 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:03.593458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:03.594220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:03.594593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:03.594871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:03.609863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:03.616324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:03.622006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:03.625660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1102/2225] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:03.640274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:03.641850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1fda6-4e18-4eb2-8db2-38d586611aad service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:03.653652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1124/2226] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:08.086095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:08.163303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac994a-9745-4dd0-b2ae-53f140b79cea service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:08.169040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:08.170325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:08.170680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:08.171063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] PATH_INFO: `/v3/users/104d88b43262457f84d444f86e3c658c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:08.172549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] RBAC: Authorizing `identity:delete_user(user_id=104d88b43262457f84d444f86e3c658c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:08.175077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:08.228540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104d88b43262457f84d444f86e3c658c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:08.238390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104d88b43262457f84d444f86e3c658c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:08.252294 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104d88b43262457f84d444f86e3c658c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:08.253221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104d88b43262457f84d444f86e3c658c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:08.253846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104d88b43262457f84d444f86e3c658c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:08.267912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1103/2227] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:08 2022] DELETE /identity/v3/users/104d88b43262457f84d444f86e3c658c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:08.272685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:08.273230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:08.273328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:08.295079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:08.296653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:08.371652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1125/2228] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:08.379044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:08.380630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:08.446833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:08.464363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7fee-b5da-49e0-8db4-1390dcdb358c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:08.469438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:08.470175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:08.470549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:08.470915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:08.481398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:08.483298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:08.495046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1104/2229] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:08.998459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.000291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.002227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.004679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.021232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20e6a7-11bf-4469-8640-8789bfb684dc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:09.023531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823573-fcd7-4f04-b951-24bad2c668c0 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:09.033094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:09.033755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:09.034030 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:09.034302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] PATH_INFO: `/v3/users/e42f53e3f2894fd8b39ef954485a266e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:09.035462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42f53e3f2894fd8b39ef954485a266e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:09.037563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:09.038446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:09.039266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:09.039691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:09.040272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] PATH_INFO: `/v3/projects/68906eede8d8424e82b26304a822b41d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:09.041508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68906eede8d8424e82b26304a822b41d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:09.043429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:09.111788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42f53e3f2894fd8b39ef954485a266e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.112601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42f53e3f2894fd8b39ef954485a266e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.123582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42f53e3f2894fd8b39ef954485a266e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.132298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42f53e3f2894fd8b39ef954485a266e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.133145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9ee1f5cb-88af-49db-bd18-e826a1d552ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42f53e3f2894fd8b39ef954485a266e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.150946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68906eede8d8424e82b26304a822b41d', 'request_id': 'req-d305c3c1-66e0-4d95-8a6a-462b4ea78739'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.160012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68906eede8d8424e82b26304a822b41d', 'request_id': 'req-d305c3c1-66e0-4d95-8a6a-462b4ea78739'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.160886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1126/2230] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:08 2022] DELETE /identity/v3/users/e42f53e3f2894fd8b39ef954485a266e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:09.165919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:09.166484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:09.166762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:09.167429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68906eede8d8424e82b26304a822b41d', 'request_id': 'req-d305c3c1-66e0-4d95-8a6a-462b4ea78739'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.188123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] The token cache is being invalidate because project 68906eede8d8424e82b26304a822b41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:09.189173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.189455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:09.190572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.191063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.192701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1105/2231] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:08 2022] DELETE /identity/v3/projects/68906eede8d8424e82b26304a822b41d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:09.197512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.200222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.251807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:09.268946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1127/2232] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:09.279333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.281786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.313680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c3c1-66e0-4d95-8a6a-462b4ea78739 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:09.324529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:09.325957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:09.326422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:09.326858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] PATH_INFO: `/v3/users/99ce3dcaa0d8416f9f9afc12ff87372b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:09.329496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ce3dcaa0d8416f9f9afc12ff87372b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:09.331971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:09.357469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139b153-caf5-461f-8d74-8fc44d471880 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:09.364680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:09.366421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:09.366421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:09.366421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:09.380709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:09.382701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:09.396956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1128/2233] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:09.413040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ce3dcaa0d8416f9f9afc12ff87372b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.422849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ce3dcaa0d8416f9f9afc12ff87372b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.436965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:09.439264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ce3dcaa0d8416f9f9afc12ff87372b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.440319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ce3dcaa0d8416f9f9afc12ff87372b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.441102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ce3dcaa0d8416f9f9afc12ff87372b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:09.460457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1106/2234] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:09 2022] DELETE /identity/v3/users/99ce3dcaa0d8416f9f9afc12ff87372b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:09.911603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.913179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:09.931464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c15556-9852-4137-aab9-60afb3171db7 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:09.970758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:09.972548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:10.082024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:10.082919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:10.083448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:10.083749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] PATH_INFO: `/v3/projects/4b7eaf2413284944822109a85e133edc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:10.084968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7eaf2413284944822109a85e133edc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:10.087190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:10.099837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcd4d8-86ba-4541-b4e6-7a75e907c900 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:10.105061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:10.105707 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:10.106287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:10.107726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] PATH_INFO: `/v3/projects/bbf59983b1e9409d809ce21d5b710a39` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:10.109052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf59983b1e9409d809ce21d5b710a39)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:10.111073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:10.170448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf59983b1e9409d809ce21d5b710a39', 'request_id': 'req-450cc7a2-ebac-4e02-9d66-0e764a6e481b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.172208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7eaf2413284944822109a85e133edc', 'request_id': 'req-18680544-8255-4b99-9433-35f9afd344e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.177537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf59983b1e9409d809ce21d5b710a39', 'request_id': 'req-450cc7a2-ebac-4e02-9d66-0e764a6e481b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.183453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7eaf2413284944822109a85e133edc', 'request_id': 'req-18680544-8255-4b99-9433-35f9afd344e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.194902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7eaf2413284944822109a85e133edc', 'request_id': 'req-18680544-8255-4b99-9433-35f9afd344e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.197072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf59983b1e9409d809ce21d5b710a39', 'request_id': 'req-450cc7a2-ebac-4e02-9d66-0e764a6e481b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.216267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] The token cache is being invalidate because project 4b7eaf2413284944822109a85e133edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:10.216830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.219093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.219093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1129/2235] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:09 2022] DELETE /identity/v3/projects/4b7eaf2413284944822109a85e133edc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:10.223791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:10.225280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:10.227042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] The token cache is being invalidate because project bbf59983b1e9409d809ce21d5b710a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:10.227513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.228449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.231135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1107/2236] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:09 2022] DELETE /identity/v3/projects/bbf59983b1e9409d809ce21d5b710a39 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:10.236607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:10.238379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:10.288614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:10.324470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cc7a2-ebac-4e02-9d66-0e764a6e481b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:10.333751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:10.334349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:10.334631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:10.334911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] PATH_INFO: `/v3/users/ba3505e1f3524e68bacb691e53ce6a3a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:10.336087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3505e1f3524e68bacb691e53ce6a3a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:10.338080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:10.339862 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680544-8255-4b99-9433-35f9afd344e7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:10.345147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:10.345790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:10.346058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:10.346407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] PATH_INFO: `/v3/users/e01f63648e3e4d29bf1edbdf8d15b3e7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:10.347559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01f63648e3e4d29bf1edbdf8d15b3e7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:10.349527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:10.369162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:10.401300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3505e1f3524e68bacb691e53ce6a3a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.414164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3505e1f3524e68bacb691e53ce6a3a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.420039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01f63648e3e4d29bf1edbdf8d15b3e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.420152 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01f63648e3e4d29bf1edbdf8d15b3e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.429006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3505e1f3524e68bacb691e53ce6a3a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.429879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3505e1f3524e68bacb691e53ce6a3a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.430725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3505e1f3524e68bacb691e53ce6a3a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.439895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01f63648e3e4d29bf1edbdf8d15b3e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.450407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01f63648e3e4d29bf1edbdf8d15b3e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.451216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1108/2237] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:10 2022] DELETE /identity/v3/users/ba3505e1f3524e68bacb691e53ce6a3a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:10.455813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01f63648e3e4d29bf1edbdf8d15b3e7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:10.488773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1130/2238] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:10 2022] DELETE /identity/v3/users/e01f63648e3e4d29bf1edbdf8d15b3e7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:10.916223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:10.917913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:10.987509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:10.989064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:11.017500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830fbd3-8d68-4bda-8b82-ba3a749ea55e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.127677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.129073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.129073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.129300 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] PATH_INFO: `/v3/projects/bc5869ef3a5e41fcaa6b311472250130` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.130482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5869ef3a5e41fcaa6b311472250130)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.132903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.166296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461a07-b1fb-4b16-aae7-6055fb9e3fc3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.176775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.177440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.177710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.177973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] PATH_INFO: `/v3/projects/4932a574c3064fb7897f33163fb46c4f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.179114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4932a574c3064fb7897f33163fb46c4f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.181149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.228110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5869ef3a5e41fcaa6b311472250130', 'request_id': 'req-c0045545-ce71-4f68-8e31-eef711cc35d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.232860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:11.237552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5869ef3a5e41fcaa6b311472250130', 'request_id': 'req-c0045545-ce71-4f68-8e31-eef711cc35d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.249026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5869ef3a5e41fcaa6b311472250130', 'request_id': 'req-c0045545-ce71-4f68-8e31-eef711cc35d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.261062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4932a574c3064fb7897f33163fb46c4f', 'request_id': 'req-40db6044-1cf2-44e9-bcf6-67e1384c71fd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.267547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] The token cache is being invalidate because project bc5869ef3a5e41fcaa6b311472250130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:11.268003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.268927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c0045545-ce71-4f68-8e31-eef711cc35d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.282074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1109/2239] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:10 2022] DELETE /identity/v3/projects/bc5869ef3a5e41fcaa6b311472250130 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:11.282244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4932a574c3064fb7897f33163fb46c4f', 'request_id': 'req-40db6044-1cf2-44e9-bcf6-67e1384c71fd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.284088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:11.287409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4932a574c3064fb7897f33163fb46c4f', 'request_id': 'req-40db6044-1cf2-44e9-bcf6-67e1384c71fd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.319266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] The token cache is being invalidate because project 4932a574c3064fb7897f33163fb46c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:11.320352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.321183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-40db6044-1cf2-44e9-bcf6-67e1384c71fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:11.325685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1131/2240] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:10 2022] DELETE /identity/v3/projects/4932a574c3064fb7897f33163fb46c4f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:11.334735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.335247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.335702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.360186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:11.361747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:11.439760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1110/2241] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:11.448558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.449021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.449300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.488778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:11.488778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:11.499472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1132/2242] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:11.503537 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.515881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6cbf-e911-42c8-91e5-b62c50b70d4b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.524832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.525540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.525907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.526237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.526996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:11.527358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.529280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.543573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1111/2243] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:11.548986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.559265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818f77f-5918-4b91-8f00-a21a74998bf4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.564978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.565690 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.566064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.566334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.567542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.569105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.609331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1133/2244] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:11 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:11.613975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.626121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c2ff-f3e6-475d-bb5e-4e19ff454c1e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.698752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.699397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.699695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.699988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.700620 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.702678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.735396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1112/2245] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:11 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:11.742038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.764583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0f8b-760d-4219-86d0-5e92b87dc9a8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.773382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.774823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.775603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.776645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.777558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.781545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.803908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1134/2246] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:11.807536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.818484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f285b9-eff2-47d1-bd63-c41b3a593e09 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.827706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.828001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.828489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.829718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.830297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.833318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86316-008e-45db-a51b-32897882c2bf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.848405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1113/2247] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:11.853144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:11.875468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b870e-2742-421f-b217-c9c7ddc7c20d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:11.880610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:11.881510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.881886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.882286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] PATH_INFO: `/v3/projects/b33f607b2bf8492192f9584b25a25123/users/af3638f308884dd3a3304ad791919289/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.900651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33f607b2bf8492192f9584b25a25123, user_id=af3638f308884dd3a3304ad791919289, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:11.903807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:11.918858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1135/2248] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:11 2022] PUT /identity/v3/projects/b33f607b2bf8492192f9584b25a25123/users/af3638f308884dd3a3304ad791919289/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:11.930064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:11.930354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:11.930621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:11.966652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] MFA Rules not processed for user `af3638f308884dd3a3304ad791919289`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:11.967886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:12.001893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:12.041621 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1114/2249] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:12.046959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.121022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade194b-057b-44b4-ac3a-e0836813601c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.126545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.126545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.126834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.127119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.127777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.129714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.159874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1136/2250] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:12 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:12.164486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.178645 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd78c3-ec61-4daa-b2f7-876b696ea72d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.265287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.265999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.266168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.266436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.267083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.269044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.293513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1115/2251] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:12 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:12.298389 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.310044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1571d7-a5a8-457c-aea9-41d736528395 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.315177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.315812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.316085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.316349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.317018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.318621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.332037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1137/2252] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:12.336496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.348414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f352d0-ff47-4ace-9972-7e158907b5a2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.354390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.355512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.356116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.357295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] PATH_INFO: `/v3/projects/bf6cd919bab747228b6689e5f433dc63/users/691e7f10aed14a12a16dea0cb9b8debc/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.375507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6cd919bab747228b6689e5f433dc63, user_id=691e7f10aed14a12a16dea0cb9b8debc, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.378286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.396148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1116/2253] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:12 2022] PUT /identity/v3/projects/bf6cd919bab747228b6689e5f433dc63/users/691e7f10aed14a12a16dea0cb9b8debc/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:12.400769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.412388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e745-3aa7-44ef-a310-f891ea765033 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.473530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:12.490925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.491558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.491835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.492311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.493056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.494793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc07c-b774-4855-ad2c-e3b963a88485 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.515425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1138/2254] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:12.518484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.533824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c82ab-b31e-4445-a677-25b1444ff655 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.544400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.545556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.545556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.547390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] PATH_INFO: `/v3/projects/bf6cd919bab747228b6689e5f433dc63/users/691e7f10aed14a12a16dea0cb9b8debc/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.549225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6cd919bab747228b6689e5f433dc63, user_id=691e7f10aed14a12a16dea0cb9b8debc, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.553877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.569026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1117/2255] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:12 2022] PUT /identity/v3/projects/bf6cd919bab747228b6689e5f433dc63/users/691e7f10aed14a12a16dea0cb9b8debc/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:12.581265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.581547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.581826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.614433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] MFA Rules not processed for user `691e7f10aed14a12a16dea0cb9b8debc`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:12.616206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:12.708476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1139/2256] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:12.721979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.723731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:12.795721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89af89-88c8-42a9-a04c-744aff87f8d0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.799750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.800368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.800647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.800951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:12.818877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:12.820347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:12.833322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1118/2257] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:12.943232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:12.958842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28ecf2-85b5-4ae3-831a-1bc82f2fb8c5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:12.964912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:12.965948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:12.966548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:12.967031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:13.073302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:13.075139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d36e-fca5-408e-bad0-b1febc84e467 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:13.086040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1140/2258] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:14.825215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:14.827432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:14.866863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:14.908017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b477-23f5-47b9-9880-2cb27d8aede9 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:14.913535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:14.913984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:14.914337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:14.914995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] PATH_INFO: `/v3/users/55ee260f2fac427cbbfb52d2ecece7d5` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:14.916297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ee260f2fac427cbbfb52d2ecece7d5)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:14.918175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:14.986061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ee260f2fac427cbbfb52d2ecece7d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:14.997221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ee260f2fac427cbbfb52d2ecece7d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.016167 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ee260f2fac427cbbfb52d2ecece7d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.017195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ee260f2fac427cbbfb52d2ecece7d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.018024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ee260f2fac427cbbfb52d2ecece7d5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.036008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1119/2259] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:14 2022] DELETE /identity/v3/users/55ee260f2fac427cbbfb52d2ecece7d5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:15.041857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:15.042900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:15.043134 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:15.071442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:15.074145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:15.150576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1141/2260] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:15.161206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:15.162704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:15.228496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c012-482e-4a67-843f-5a3400aae621 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:15.232925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:15.233550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:15.233826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:15.234097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:15.244197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:15.245717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d1d3-05e0-4e54-964d-6df561ed0fe5 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:15.256938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1120/2261] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:15.661495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:15.662989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:15.692568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e51a1-808b-473d-bd37-2e33aee8e8a3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:15.704874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:15.706186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:15.706819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:15.707367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] PATH_INFO: `/v3/projects/a4d72f4f266b45b5bfd34fc3dd4c3fb4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:15.711824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d72f4f266b45b5bfd34fc3dd4c3fb4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:15.718370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:15.734704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:15.810035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d72f4f266b45b5bfd34fc3dd4c3fb4', 'request_id': 'req-d505e535-1edf-45f6-a894-87dcf3e2731f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.823652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d72f4f266b45b5bfd34fc3dd4c3fb4', 'request_id': 'req-d505e535-1edf-45f6-a894-87dcf3e2731f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.853935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d72f4f266b45b5bfd34fc3dd4c3fb4', 'request_id': 'req-d505e535-1edf-45f6-a894-87dcf3e2731f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.875893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] The token cache is being invalidate because project a4d72f4f266b45b5bfd34fc3dd4c3fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:15.876321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.877070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d505e535-1edf-45f6-a894-87dcf3e2731f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:15.878617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1142/2262] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:15 2022] DELETE /identity/v3/projects/a4d72f4f266b45b5bfd34fc3dd4c3fb4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:15.886174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:15.886174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:15.886174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:15.908583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:15.909778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:15.983792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:16.007267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1121/2263] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:16.018170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.018868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.019371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.069531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:16.071411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:16.086000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1143/2264] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:16.094599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.112733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345906a9-48c8-48cd-a4b6-809247af12d1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.122155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.122951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.123252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.123526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.124188 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:16.124494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.126182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.156866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1122/2265] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:16.160651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.174322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b10525-2182-432f-91e7-7b400ba96ed6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.181718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.182350 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.182614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.182958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.183591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.186004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.233048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1144/2266] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:16.238223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.263309 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2fa9e-03c0-45e9-b768-341c0a9b086d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.353328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.354282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.354563 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.355141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.355712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.358907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.392120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1123/2267] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:16 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:16.397867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.417485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7d7be-f054-4f1d-984b-e8eefeb68be2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.426642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.427762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.428355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.428898 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.436683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.436683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.454276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1145/2268] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:16.458504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.469359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e8a9-f85a-47b2-865e-8df58d273969 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.474559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.475175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.475431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.475840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.476630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.478268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a94da-866a-4fac-9c89-80f2e482a637 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.496902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1124/2269] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:16.500554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.512800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccc1c3-34fb-4e2a-a6c3-e3de0951b634 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.525710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.526559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.526820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.527361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] PATH_INFO: `/v3/projects/cf053a9ecf294a43a3d7b2c17c41f2e5/users/8bfe4096670b4b84911f2515b0355194/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.557998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf053a9ecf294a43a3d7b2c17c41f2e5, user_id=8bfe4096670b4b84911f2515b0355194, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.561935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.583890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1146/2270] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:16 2022] PUT /identity/v3/projects/cf053a9ecf294a43a3d7b2c17c41f2e5/users/8bfe4096670b4b84911f2515b0355194/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:16.598282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.598700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.599016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.654602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] MFA Rules not processed for user `8bfe4096670b4b84911f2515b0355194`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:16.657063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:16.781069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1125/2271] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:16.841536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:16.844345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:16.934129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57f6e-86f5-4f71-846e-5e765ffc29fa admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:16.937955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:16.938635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:16.938905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:16.939168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:16.948186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:16.949662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e2e8f-8aae-4b72-9bf9-4bcde0fec756 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:16.959869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1147/2272] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:20.312097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:20.315336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:20.382430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:20.457043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54392b26-3ae6-4f50-ba84-22258a067f47 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:20.462505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:20.463524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.464008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.464490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] PATH_INFO: `/v3/users/af3638f308884dd3a3304ad791919289` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.466580 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3638f308884dd3a3304ad791919289)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:20.469220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:20.560571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3638f308884dd3a3304ad791919289'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:20.570052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3638f308884dd3a3304ad791919289'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:20.587903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3638f308884dd3a3304ad791919289'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:20.588681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3638f308884dd3a3304ad791919289'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:20.589340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3638f308884dd3a3304ad791919289'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:20.605464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1126/2273] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:20 2022] DELETE /identity/v3/users/af3638f308884dd3a3304ad791919289 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:20.612804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.613318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.613723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.649500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:20.651059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:20.693965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:20.728706 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1148/2274] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:20.740587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:20.742446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:20.819227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc9480-be1e-4f9d-9b8d-62ef1ee6f726 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:20.824468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:20.825890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:20.826384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:20.826908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:20.853413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:20.855398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:20.873838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1127/2275] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:21.241193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:21.242660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:21.255344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb267b9-637a-4c38-967a-d8e62bc48182 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:21.261315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:21.262492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:21.262792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:21.263105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] PATH_INFO: `/v3/projects/b33f607b2bf8492192f9584b25a25123` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:21.265568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33f607b2bf8492192f9584b25a25123)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:21.268099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:21.326267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33f607b2bf8492192f9584b25a25123', 'request_id': 'req-3927663e-6b87-4fbd-9062-eae547fec460'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.333576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33f607b2bf8492192f9584b25a25123', 'request_id': 'req-3927663e-6b87-4fbd-9062-eae547fec460'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.340875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33f607b2bf8492192f9584b25a25123', 'request_id': 'req-3927663e-6b87-4fbd-9062-eae547fec460'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.358309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] The token cache is being invalidate because project b33f607b2bf8492192f9584b25a25123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:21.358609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.359427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.361333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1149/2276] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:21 2022] DELETE /identity/v3/projects/b33f607b2bf8492192f9584b25a25123 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:21.366168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:21.382585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a34ca-49c9-40b6-af77-f3c7cfb60c50 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:21.493904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:21.494672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:21.494922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:21.495182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] PATH_INFO: `/v3/users/691e7f10aed14a12a16dea0cb9b8debc` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:21.497162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691e7f10aed14a12a16dea0cb9b8debc)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:21.499209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:21.507238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:21.581520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691e7f10aed14a12a16dea0cb9b8debc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.608521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691e7f10aed14a12a16dea0cb9b8debc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.650083 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691e7f10aed14a12a16dea0cb9b8debc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.651776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691e7f10aed14a12a16dea0cb9b8debc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.654435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2698e7e0-d859-4e7b-95a2-be9f5a918e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691e7f10aed14a12a16dea0cb9b8debc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:21.677964 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1128/2277] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:21 2022] DELETE /identity/v3/users/691e7f10aed14a12a16dea0cb9b8debc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:22.100553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.106998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:22.132960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927663e-6b87-4fbd-9062-eae547fec460 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.262212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.263787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.264143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.264408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] PATH_INFO: `/v3/projects/bf6cd919bab747228b6689e5f433dc63` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.265860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6cd919bab747228b6689e5f433dc63)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.268103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.343118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6cd919bab747228b6689e5f433dc63', 'request_id': 'req-73889b68-1044-4c70-901d-2b560cbbb5c9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:22.351187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6cd919bab747228b6689e5f433dc63', 'request_id': 'req-73889b68-1044-4c70-901d-2b560cbbb5c9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:22.358161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:22.360337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6cd919bab747228b6689e5f433dc63', 'request_id': 'req-73889b68-1044-4c70-901d-2b560cbbb5c9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:22.386837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] The token cache is being invalidate because project bf6cd919bab747228b6689e5f433dc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:22.387157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:22.387846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-73889b68-1044-4c70-901d-2b560cbbb5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:22.390625 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1150/2278] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:22 2022] DELETE /identity/v3/projects/bf6cd919bab747228b6689e5f433dc63 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:22.397398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb59c-d752-433a-9439-dff8ef011700 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.398285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb59c-d752-433a-9439-dff8ef011700 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.398285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfb59c-d752-433a-9439-dff8ef011700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.423396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2acfb59c-d752-433a-9439-dff8ef011700 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:22.424545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2acfb59c-d752-433a-9439-dff8ef011700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:22.509289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1129/2279] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:22.526729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.527016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.527289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.558363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.560988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.561488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.581232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:22.585096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:22.598149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1151/2280] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:22.603329 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] MFA Rules not processed for user `f062d87e5ab84dff99ffcaaa730efd41`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:22.604856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.605095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:22.622584 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550fcb8-9751-43fc-b536-af981612cc89 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.631186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.632185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.632661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.633338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.634498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:22.634923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.637888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.660842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1152/2281] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:22.664317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.681359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b867f-91c1-4655-b2aa-431dc5270992 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.689229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.690164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.690639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.691235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.692445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.695094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.705119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1130/2282] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:22.738047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1153/2283] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:22 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:22.742547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.757601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183eee1-c4eb-4f61-879a-9604a6579030 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.813787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:22.862178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.863049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.863049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.863254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.863788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.866737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.890794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1131/2284] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:22 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:22.895616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.918054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e623ca4-f367-473e-8df7-e2adc3c795d3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.928402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.929462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.930037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.930491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.931713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.935130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.956803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1154/2285] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:22.960860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:22.973340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405f83-45a8-4bab-a975-91f66d146055 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:22.980026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:22.980881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:22.981781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:22.981898 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:22.986011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:22.986011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661063c7-85fe-466e-b281-c674a1fc6f80 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:22.997569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1132/2286] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:23.004471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.031245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b915d-5b05-45d6-9d57-a83d5a93003b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.047432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.048786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.051700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.052010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] PATH_INFO: `/v3/projects/efa50f9dc22744489d58bddc4d2f0cf2/users/93f87676945d45728d5525e80b63f451/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.070756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa50f9dc22744489d58bddc4d2f0cf2, user_id=93f87676945d45728d5525e80b63f451, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.074055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.095969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1155/2287] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:23 2022] PUT /identity/v3/projects/efa50f9dc22744489d58bddc4d2f0cf2/users/93f87676945d45728d5525e80b63f451/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:23.108348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.108636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.108951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.162739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] MFA Rules not processed for user `93f87676945d45728d5525e80b63f451`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:23.164095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:23.266087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1133/2288] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:23.267340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.344141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.346418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:23.363042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227565d-6c38-4976-ae25-e3986ce5a473 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.369038 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.369910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.370326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.370756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.371631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.373635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.409455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1156/2289] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:23.413395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.454139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038f40-0648-49ea-8b44-f85ea1ce4019 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.503201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:23.508621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30485023-d423-43d8-b358-4379a911eac5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.529272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.531069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.531352 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.531955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.532795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.535138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.537098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:23.561136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.561997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.562269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.562577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] PATH_INFO: `/v3/users/8bfe4096670b4b84911f2515b0355194` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.564242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfe4096670b4b84911f2515b0355194)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.565451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1157/2290] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:23.566422 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.570937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.583974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327813a7-1656-4720-805d-8ed9903cac65 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.591729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.592648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.593079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.593405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.594149 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.596011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.612593 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1158/2291] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:23.617629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.633395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1424-dc26-410f-8b01-562f5573ccf3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.640374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.641345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.641970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.641970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.642664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.646110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.653974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfe4096670b4b84911f2515b0355194'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:23.671373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1159/2292] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:23.677806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.680311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfe4096670b4b84911f2515b0355194'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:23.691547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4622aa-bc2e-4f20-bce1-d1a37a455785 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:23.699375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:23.701044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.701589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.701867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfe4096670b4b84911f2515b0355194'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:23.701987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] PATH_INFO: `/v3/projects/97a56c3d1e3c4d19b1dc011400c40f6d/users/4f2e49d21fc64527bcb738a65d0201a0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.709277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfe4096670b4b84911f2515b0355194'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:23.710327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-40ac8fe0-830d-4ec5-a265-84e8192a6868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfe4096670b4b84911f2515b0355194'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:23.743428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a56c3d1e3c4d19b1dc011400c40f6d, user_id=4f2e49d21fc64527bcb738a65d0201a0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:23.743687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1134/2293] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:23 2022] DELETE /identity/v3/users/8bfe4096670b4b84911f2515b0355194 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:23.753349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.753768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.754921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.761078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337608e-48bd-46c6-876f-96ebc3393438 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:23.782522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:23.784103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:23.790300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1160/2294] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:23 2022] PUT /identity/v3/projects/97a56c3d1e3c4d19b1dc011400c40f6d/users/4f2e49d21fc64527bcb738a65d0201a0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:23.801667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:23.802125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:23.802525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:23.870526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] MFA Rules not processed for user `4f2e49d21fc64527bcb738a65d0201a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:23.871841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:23.925710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1135/2295] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:23.935477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:23.937789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.011424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1161/2296] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:24.016519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.019242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.044072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529e8d5-fd47-48c0-b2d6-0858105c76a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.047171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0cd302-c6da-4917-a555-6e0c77c12c16 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.050844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.051472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.051746 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.051974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.052098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.052645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.052876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.053149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.053485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.054980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.070971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.075591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.099753 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1136/2297] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:24.133942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1162/2298] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:24 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:24.139486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.157319 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6649e-3799-47d7-ab75-065656ba296e service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.163808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:24.293971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.294751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.296403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.296965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.299227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.301293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.393965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1137/2299] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:24 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:24.403157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.434049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ee2b3-429d-4198-a13b-ab4c82a32318 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.450803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.452175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.452452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.455319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.456047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.458911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.482631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1163/2300] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:24.485666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.501323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6460d-35e6-4f97-a903-3853f8baa0b5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.517996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.520847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.521424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.521905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] PATH_INFO: `/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85/users/e9b629821b5b4919bd6f79eac3ffe495/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.565379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5355799a4f4cb2b33f14d1aa7caa85, user_id=e9b629821b5b4919bd6f79eac3ffe495, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.572953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.573444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.577592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.627337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61da7b-ff9f-4ad4-9d3e-678523d3686f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.635170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1138/2301] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:24 2022] PUT /identity/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85/users/e9b629821b5b4919bd6f79eac3ffe495/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:24.640082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.742832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:24.757022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ffec3-147e-40d3-8485-365af151c61a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.758408 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.760114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.760582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.760695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] PATH_INFO: `/v3/projects/cf053a9ecf294a43a3d7b2c17c41f2e5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.762904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf053a9ecf294a43a3d7b2c17c41f2e5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.764210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.766684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.767561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.767815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.768244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.769140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.771239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.788091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1139/2302] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:24.792501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:24.805862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e29a1-9fd8-448e-9593-4e5998743bb6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:24.815072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:24.815810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.816139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.816429 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] PATH_INFO: `/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85/users/e9b629821b5b4919bd6f79eac3ffe495/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.819480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5355799a4f4cb2b33f14d1aa7caa85, user_id=e9b629821b5b4919bd6f79eac3ffe495, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:24.823881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d69539-f74f-4777-94df-dcbb29bebb2a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:24.841903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1140/2303] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:24 2022] PUT /identity/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85/users/e9b629821b5b4919bd6f79eac3ffe495/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:24.854304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf053a9ecf294a43a3d7b2c17c41f2e5', 'request_id': 'req-d184a865-46bb-4eca-8c3c-82e25723d38d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:24.857851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.858274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.858570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.869495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf053a9ecf294a43a3d7b2c17c41f2e5', 'request_id': 'req-d184a865-46bb-4eca-8c3c-82e25723d38d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:24.880374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf053a9ecf294a43a3d7b2c17c41f2e5', 'request_id': 'req-d184a865-46bb-4eca-8c3c-82e25723d38d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:24.898046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] MFA Rules not processed for user `e9b629821b5b4919bd6f79eac3ffe495`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:24.899814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.906891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] The token cache is being invalidate because project cf053a9ecf294a43a3d7b2c17c41f2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:24.907397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:24.908246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d184a865-46bb-4eca-8c3c-82e25723d38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:24.910695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1164/2304] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:24 2022] DELETE /identity/v3/projects/cf053a9ecf294a43a3d7b2c17c41f2e5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:24.918005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b773a6-7daa-4d19-8abc-54edf5b68727 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:24.918492 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b773a6-7daa-4d19-8abc-54edf5b68727 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:24.919587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b773a6-7daa-4d19-8abc-54edf5b68727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:24.949794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-72b773a6-7daa-4d19-8abc-54edf5b68727 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:24.954324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-72b773a6-7daa-4d19-8abc-54edf5b68727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:24.974909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:25.008592 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1141/2305] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:25.022410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.023755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.044285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1165/2306] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:25.052965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.053247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.053490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.081079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:25.082871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.094085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1166/2307] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:25.098368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.107657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d47c82-6bd5-41dc-93f3-b674f1fd8b1d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.108334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f6587-5b59-4c04-ac30-e0bf252ddbfc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.112171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.113172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.113372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.113779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.117129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.117288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.117288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.117288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.117710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.118519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:25.118923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.120621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.136945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1167/2308] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:16:25.141902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.153730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a258215-3713-495e-aa3a-a2beb696117a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.166306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.166929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.167195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.167455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.168094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.170437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.211512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1168/2309] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:25.214902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.217629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.218616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.231395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1142/2310] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:25.313468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:25.342344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24d6e3-3613-49c1-ace7-774b3752fb6e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.347721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.348281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.348557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.348867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.349532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.351463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.382819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1169/2311] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:25.387715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.404357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5537-3a08-48e5-acd1-bb21ce3ea192 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.412998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.414155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.415582 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.416292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.417743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.421963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.444829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1143/2312] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:25.450336 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.451935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.454872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.470931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543abec-24d9-4fa6-9627-99a20651b704 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.478682 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.479813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.480348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.481446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.482825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.485959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.492982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee7c1-e880-43a4-b08e-541c82c16de8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.509496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.510210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.510821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.511222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1170/2313] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:25.512417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] PATH_INFO: `/v3/users/8416c998cbca4db493d4011d0be4d1f0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.513009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.513800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8416c998cbca4db493d4011d0be4d1f0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.518780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.531800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c251de-d812-4a93-92f1-6092deca0459 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:25.541018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:25.542178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.542830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.543603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] PATH_INFO: `/v3/projects/10ad03735583468aaebac332e26c5469/users/68658641d77c4b189f9879a713c346f9/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.585557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ad03735583468aaebac332e26c5469, user_id=68658641d77c4b189f9879a713c346f9, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:25.588778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e56c8-d8da-4e90-8487-4b4cd4814f78 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:25.618270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1171/2314] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:25 2022] PUT /identity/v3/projects/10ad03735583468aaebac332e26c5469/users/68658641d77c4b189f9879a713c346f9/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:25.628310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8416c998cbca4db493d4011d0be4d1f0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:25.635015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.635807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.636302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.655283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8416c998cbca4db493d4011d0be4d1f0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:25.690353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8416c998cbca4db493d4011d0be4d1f0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:25.693697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8416c998cbca4db493d4011d0be4d1f0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:25.695450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4d8cd9fe-d423-46d6-a434-65d0f2365b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8416c998cbca4db493d4011d0be4d1f0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:25.732655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:25.749001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] MFA Rules not processed for user `68658641d77c4b189f9879a713c346f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:25.751678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.758372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1144/2315] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:25 2022] DELETE /identity/v3/users/8416c998cbca4db493d4011d0be4d1f0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:25.763657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:25.765057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:25.770889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:25.833290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:25.835567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:25.940360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1172/2316] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:25.945614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:25.947779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.071974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ca593-5e9a-4232-88ca-560b7186df45 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.079997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.081140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.081565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.081975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.083018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.085917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.116061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1145/2317] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:26.128140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.129937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.146015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1173/2318] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:25 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:26.150041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.179957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:26.237307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072cbdb-9a4f-4d2a-a792-355c17166b30 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.253489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482badb-4475-42cc-8f99-e08aa8955eae admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.259376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.260058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.260346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.260635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.261360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.264074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.288143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1174/2319] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:26 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:26.293061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.306099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ae5d-c9a7-451b-9eaf-4fc0fb031b21 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.312965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.313687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.313971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.314315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.314896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.315863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.316542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.316656 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.316980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.317696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.329036 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.330476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.331602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1175/2320] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:26.338353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.344006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1146/2321] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:26.353869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475b9e9-26ec-4549-9483-07c460e01c31 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.363570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.365104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.365445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.365815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] PATH_INFO: `/v3/projects/e98156ae640d41518ec496c6362a09b5/users/cfc9d47ea1b64ac781ec0ec1b82aa378/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.386504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98156ae640d41518ec496c6362a09b5, user_id=cfc9d47ea1b64ac781ec0ec1b82aa378, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.391481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.409284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1176/2322] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:26 2022] PUT /identity/v3/projects/e98156ae640d41518ec496c6362a09b5/users/cfc9d47ea1b64ac781ec0ec1b82aa378/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:26.413754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.423778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592917dc-9d6e-49c4-a0ad-46fe5222517d service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.489717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:26.501610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.502644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.502939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.503216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.503875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.505890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ccdd3-bc92-429e-85a9-76bcf55aa90e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.518133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1147/2323] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:26.522939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.535181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebad04-0228-43ae-8551-3441dd388ae4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.541922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.542643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.542990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.543363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] PATH_INFO: `/v3/projects/e98156ae640d41518ec496c6362a09b5/users/cfc9d47ea1b64ac781ec0ec1b82aa378/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.546458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98156ae640d41518ec496c6362a09b5, user_id=cfc9d47ea1b64ac781ec0ec1b82aa378, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.549982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.567461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1177/2324] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:26 2022] PUT /identity/v3/projects/e98156ae640d41518ec496c6362a09b5/users/cfc9d47ea1b64ac781ec0ec1b82aa378/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:26.578369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.578877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.579146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.619315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] MFA Rules not processed for user `cfc9d47ea1b64ac781ec0ec1b82aa378`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:26.620733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.708729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1148/2325] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:26.722104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.724467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.820809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b980-de0f-4a9e-97d2-bcb79c090cf5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:26.826259 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:26.827218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:26.827558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:26.827900 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:26.917520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:26.919745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:26.954684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:26.956652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:26.971515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1178/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:27.059272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.061226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.074450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce2899-2ac0-40a7-bd4c-21f8006165d9 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.079369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.080342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.080805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.081210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.083203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.095481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:27.141916 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984ae09-cfb6-4eef-94fb-69d61e3df5de None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.160627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.161461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.161786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.162223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] PATH_INFO: `/v3/projects/389042dcd2c04217912d61e5bf2bd545` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.163553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389042dcd2c04217912d61e5bf2bd545)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.166049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.173081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.174534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d03af-b1a2-4156-a55d-415576c0dcb9 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.197808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1179/2327] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:27.292573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389042dcd2c04217912d61e5bf2bd545', 'request_id': 'req-aba90c41-3194-4c75-95e6-3186203f02d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:27.310360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389042dcd2c04217912d61e5bf2bd545', 'request_id': 'req-aba90c41-3194-4c75-95e6-3186203f02d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:27.336287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389042dcd2c04217912d61e5bf2bd545', 'request_id': 'req-aba90c41-3194-4c75-95e6-3186203f02d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:27.362857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] The token cache is being invalidate because project 389042dcd2c04217912d61e5bf2bd545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:27.365193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:27.367396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aba90c41-3194-4c75-95e6-3186203f02d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:27.372792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1149/2328] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:26 2022] DELETE /identity/v3/projects/389042dcd2c04217912d61e5bf2bd545 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:27.377198 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.377970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.378894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.423072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:27.429484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.595516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1180/2329] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:27.602399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.602399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.602399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.672944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:27.674194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:27.685905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1150/2330] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:27.690507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.709629 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba23a7-aa5e-47ad-9551-bb2141897d14 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.721996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.723318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.723804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.724854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.725851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:27.726348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.728724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.769313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1181/2331] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:27.771871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.779311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:27.789240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bae7f0-05c6-4896-8bd2-20d20505e576 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:27.798623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:27.800014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:27.800911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:27.801493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:27.802888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:27.810991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:27.861112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:27.867179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1151/2332] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:27.875130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6601b0-ebfb-4f94-952e-8b758444912c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.010011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.011018 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.011500 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.011980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.012955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.015186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.054024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.058293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1182/2333] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:27 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:28.078761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa29340-fcc4-4e29-a4b9-26bc04cfbc36 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.106706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.108133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.108640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.109087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.110507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.112402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.135932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1152/2334] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:28.138981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.157067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877e88-550a-43d5-a174-b95fb998675e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.167098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.167331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.167734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.168300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.168300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.171118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b4440-ce71-4572-ae06-0256ec42ec9c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.187258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1183/2335] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:28.192305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.207601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061c21-bc65-4853-8a90-812796c8b763 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.223489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.226238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.226745 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.227160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] PATH_INFO: `/v3/projects/dae2dbee1cbc4dc0af5146768bd5cc90/users/31321189796b469ca4317f27a608f21c/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.250184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae2dbee1cbc4dc0af5146768bd5cc90, user_id=31321189796b469ca4317f27a608f21c, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.255665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.283260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1153/2336] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:28 2022] PUT /identity/v3/projects/dae2dbee1cbc4dc0af5146768bd5cc90/users/31321189796b469ca4317f27a608f21c/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:28.304159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.304491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.304727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.340857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] MFA Rules not processed for user `31321189796b469ca4317f27a608f21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:28.342313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:28.347317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:28.415421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.417460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:28.460632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1184/2337] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:28.470696 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.473993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:28.511934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04d43-d157-41da-b75c-b437e860c53f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.518106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.518788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.519066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.519335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.521243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:28.562334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a630363-f9fe-4ad3-aa82-28c701324067 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.568153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.569453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.570020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.570468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.587404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.590778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.604344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1185/2338] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:28.633343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.633827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a68c-895d-4b84-8130-55270f5194a8 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.634264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:28.646433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1154/2339] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:28.784631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130802-20c3-43f2-bbb7-291e2cf384dc service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:28.791294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:28.792067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.792355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.792792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] PATH_INFO: `/v3/users/31321189796b469ca4317f27a608f21c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.794115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=31321189796b469ca4317f27a608f21c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:28.799398 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:28.906936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31321189796b469ca4317f27a608f21c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:28.908001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31321189796b469ca4317f27a608f21c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:28.912179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:28.920955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31321189796b469ca4317f27a608f21c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:28.930922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31321189796b469ca4317f27a608f21c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:28.931757 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31321189796b469ca4317f27a608f21c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:28.958884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1186/2340] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:28 2022] DELETE /identity/v3/users/31321189796b469ca4317f27a608f21c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:28.964274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905d21-c7be-484f-b934-8bec980af86f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:28.964560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905d21-c7be-484f-b934-8bec980af86f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:28.964841 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905d21-c7be-484f-b934-8bec980af86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:28.992871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-da905d21-c7be-484f-b934-8bec980af86f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:28.994233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-da905d21-c7be-484f-b934-8bec980af86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:29.053608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:29.067435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1155/2341] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:29.083439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:29.085608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:29.151178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e631-16f1-4d1e-82cb-a7cd542110cb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:29.155745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:29.156367 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.156641 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.156943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.167066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:29.169477 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:29.179887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1187/2342] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:29.526334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905d21-c7be-484f-b934-8bec980af86f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:29.528129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-da905d21-c7be-484f-b934-8bec980af86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:29.546793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905d21-c7be-484f-b934-8bec980af86f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:29.553238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:29.554114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:29.554652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:29.554876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] PATH_INFO: `/v3/projects/dae2dbee1cbc4dc0af5146768bd5cc90` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:29.556728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae2dbee1cbc4dc0af5146768bd5cc90)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:29.559196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:29.613021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae2dbee1cbc4dc0af5146768bd5cc90', 'request_id': 'req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:29.619204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae2dbee1cbc4dc0af5146768bd5cc90', 'request_id': 'req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:29.625873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae2dbee1cbc4dc0af5146768bd5cc90', 'request_id': 'req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:29.640348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] The token cache is being invalidate because project dae2dbee1cbc4dc0af5146768bd5cc90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:29.641066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:29.641413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca7f659c-c7ae-424b-97f8-bdfa2b40dd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:29.643385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1156/2343] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:29 2022] DELETE /identity/v3/projects/dae2dbee1cbc4dc0af5146768bd5cc90 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:30.020577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:30.022175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:30.039353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2e903-accc-4ddd-af55-085c544c0a4e service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:30.116236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:30.116950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:30.117662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:30.117662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] PATH_INFO: `/v3/users/68658641d77c4b189f9879a713c346f9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:30.118882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68658641d77c4b189f9879a713c346f9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:30.121782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:30.234563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68658641d77c4b189f9879a713c346f9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:30.235327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68658641d77c4b189f9879a713c346f9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:30.265447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68658641d77c4b189f9879a713c346f9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:30.279546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68658641d77c4b189f9879a713c346f9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:30.280150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68658641d77c4b189f9879a713c346f9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:30.290498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:30.314405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1188/2344] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:30 2022] DELETE /identity/v3/users/68658641d77c4b189f9879a713c346f9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:30.319299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:30.319738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:30.320082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:30.343637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:30.344566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:30.416069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1157/2345] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:30.427649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:30.429121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:30.514430 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989010-83c7-4f20-be0b-a579fd31ee97 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:30.518968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:30.519613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:30.519894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:30.520165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:30.532502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:30.534199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:30.550453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1189/2346] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:30.976538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:30.978779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:30.994044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52367662-0e63-406e-b96c-00ad7f16e61b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:31.003350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:31.003852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.004471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.004907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] PATH_INFO: `/v3/projects/10ad03735583468aaebac332e26c5469` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.006211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ad03735583468aaebac332e26c5469)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:31.009117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:31.079024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ad03735583468aaebac332e26c5469', 'request_id': 'req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.086037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ad03735583468aaebac332e26c5469', 'request_id': 'req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.092637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ad03735583468aaebac332e26c5469', 'request_id': 'req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.110779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] The token cache is being invalidate because project 10ad03735583468aaebac332e26c5469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:31.110779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.111206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.113132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1158/2347] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:30 2022] DELETE /identity/v3/projects/10ad03735583468aaebac332e26c5469 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:31.117162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:31.128179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2419fc-765c-4f03-a888-6254db18b730 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:31.209703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:31.210782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:31.211085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:31.211571 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] PATH_INFO: `/v3/users/cfc9d47ea1b64ac781ec0ec1b82aa378` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:31.213676 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc9d47ea1b64ac781ec0ec1b82aa378)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:31.217721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:31.337103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc9d47ea1b64ac781ec0ec1b82aa378'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.337525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc9d47ea1b64ac781ec0ec1b82aa378'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.361481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc9d47ea1b64ac781ec0ec1b82aa378'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.379569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc9d47ea1b64ac781ec0ec1b82aa378'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.380290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ce1c39a-a4de-4d6b-bf65-00cf073213ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc9d47ea1b64ac781ec0ec1b82aa378'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:31.410224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1190/2348] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:31 2022] DELETE /identity/v3/users/cfc9d47ea1b64ac781ec0ec1b82aa378 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:32.393208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.394939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:32.406012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.415210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa3a4e-ecae-4b8c-bcc5-2c71f478c125 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.486717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.489267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.489267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.489267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] PATH_INFO: `/v3/projects/e98156ae640d41518ec496c6362a09b5` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.490907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98156ae640d41518ec496c6362a09b5)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.494611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.555520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98156ae640d41518ec496c6362a09b5', 'request_id': 'req-01f94e33-9655-4eef-b383-478e2c975f23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:32.563659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98156ae640d41518ec496c6362a09b5', 'request_id': 'req-01f94e33-9655-4eef-b383-478e2c975f23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:32.569890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98156ae640d41518ec496c6362a09b5', 'request_id': 'req-01f94e33-9655-4eef-b383-478e2c975f23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:32.585940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] The token cache is being invalidate because project e98156ae640d41518ec496c6362a09b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:32.586373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:32.587027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-01f94e33-9655-4eef-b383-478e2c975f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:32.588647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1159/2349] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:32 2022] DELETE /identity/v3/projects/e98156ae640d41518ec496c6362a09b5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:32.593766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.594293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.594293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.616998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:32.618136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:32.624727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:32.692409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1191/2350] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:32.700530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.701180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.701450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.723000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:32.724211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:32.733257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1160/2351] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:32.737765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.749428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bcd4d-09dc-4cd3-bbb5-2d2e3af5a6fb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.754528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.755184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.755462 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.755727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.756733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:32.757070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.758803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.772740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1192/2352] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:32.777118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.786960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bdd92-4833-463a-bee8-21cbe3b32861 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.791794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.792405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.792672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.792970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.793721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.795670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.827066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1161/2353] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:32 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:32.831437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.845415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129eeb4-82e5-4c50-849d-74d0258f4103 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:32.938722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:32.939755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:32.940231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:32.940685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:32.941567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:32.944365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:32.982733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1193/2354] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:32 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:32.986009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.987510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:32.987940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:33.002380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5290-d027-4fec-99e1-005af8611888 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.014047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ade5-5e0a-4391-8b4f-1ac7dec5f77b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.018282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.019093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.019207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.019312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.019467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] PATH_INFO: `/v3/users/93f87676945d45728d5525e80b63f451` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.019924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.020254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.020583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.021326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.023062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.025543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f87676945d45728d5525e80b63f451)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.028714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.045991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1194/2355] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:33.047583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:33.061466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db341ab0-a22b-444d-a9a7-5403101bcd7e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.067513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.068202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.068537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.068896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.069612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.071434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.096784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1195/2356] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:33.098559 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:33.111238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855cb4a-4e12-4ace-a68d-cecc9c0be4c7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.117448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.118200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.118536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.118868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] PATH_INFO: `/v3/projects/95e930c1a35841cfa123c9ad819978c4/users/cd88b469805b4e7bba0c6a9b42aee021/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.122339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f87676945d45728d5525e80b63f451'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:33.131283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f87676945d45728d5525e80b63f451'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:33.133395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:33.139006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e930c1a35841cfa123c9ad819978c4, user_id=cd88b469805b4e7bba0c6a9b42aee021, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.142982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae84f4-64a6-443e-8783-a4705457d6c3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.152381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f87676945d45728d5525e80b63f451'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:33.153254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f87676945d45728d5525e80b63f451'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:33.154129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55106052-60d4-4b12-97dd-b4d06e4e71ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f87676945d45728d5525e80b63f451'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:33.162988 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1196/2357] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:33 2022] PUT /identity/v3/projects/95e930c1a35841cfa123c9ad819978c4/users/cd88b469805b4e7bba0c6a9b42aee021/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:33.173301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1162/2358] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:32 2022] DELETE /identity/v3/users/93f87676945d45728d5525e80b63f451 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:33.183629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.183931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.184088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.184209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.184290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.184371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.211432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:33.216266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:33.218865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] MFA Rules not processed for user `cd88b469805b4e7bba0c6a9b42aee021`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:33.220318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:33.313616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:33.319254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1163/2359] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:33.340546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:33.342930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:33.399258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1197/2360] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:33.426574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:33.436914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:33.470690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e60f66-e403-4d8a-a98d-f983617b1d03 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.475760 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.476410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.476690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.477010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.488030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.490122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.501956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1164/2361] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:16:33.520577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edce4-7e7f-4f30-98d2-563871303797 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:33.525085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:33.525723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:33.525973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:33.526238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:33.537847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:33.539289 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:33.553311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1198/2362] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:34.323057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:34.325624 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:34.342424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86079a7-9564-4cf3-859b-75d40c22526b service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:34.351079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:34.351729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:34.352121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:34.352451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] PATH_INFO: `/v3/projects/efa50f9dc22744489d58bddc4d2f0cf2` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:34.363415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa50f9dc22744489d58bddc4d2f0cf2)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:34.368114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:34.484147 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa50f9dc22744489d58bddc4d2f0cf2', 'request_id': 'req-42763e31-6101-49b1-9c47-93f3e391d570'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.497450 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa50f9dc22744489d58bddc4d2f0cf2', 'request_id': 'req-42763e31-6101-49b1-9c47-93f3e391d570'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.503894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa50f9dc22744489d58bddc4d2f0cf2', 'request_id': 'req-42763e31-6101-49b1-9c47-93f3e391d570'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.505823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:34.538185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] The token cache is being invalidate because project efa50f9dc22744489d58bddc4d2f0cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:34.538697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.540030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.542769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1165/2363] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:34 2022] DELETE /identity/v3/projects/efa50f9dc22744489d58bddc4d2f0cf2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:34.549353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:34.572635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d425-8fec-4561-a846-0adedd33d097 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:34.669062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:34.670192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:34.671014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:34.671526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] PATH_INFO: `/v3/users/4f2e49d21fc64527bcb738a65d0201a0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:34.673813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2e49d21fc64527bcb738a65d0201a0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:34.677461 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:34.762792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2e49d21fc64527bcb738a65d0201a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.763607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2e49d21fc64527bcb738a65d0201a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.772031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2e49d21fc64527bcb738a65d0201a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.782849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2e49d21fc64527bcb738a65d0201a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.784109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2e49d21fc64527bcb738a65d0201a0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:34.822547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1199/2364] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:34 2022] DELETE /identity/v3/users/4f2e49d21fc64527bcb738a65d0201a0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:35.229355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:35.233242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:35.272689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763e31-6101-49b1-9c47-93f3e391d570 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:35.398614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:35.399499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.399861 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.400247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] PATH_INFO: `/v3/projects/97a56c3d1e3c4d19b1dc011400c40f6d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.401855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a56c3d1e3c4d19b1dc011400c40f6d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:35.404124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:35.491134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a56c3d1e3c4d19b1dc011400c40f6d', 'request_id': 'req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.500454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a56c3d1e3c4d19b1dc011400c40f6d', 'request_id': 'req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.517830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a56c3d1e3c4d19b1dc011400c40f6d', 'request_id': 'req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.543506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] The token cache is being invalidate because project 97a56c3d1e3c4d19b1dc011400c40f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:35.544023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.544939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.546776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1166/2365] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:35 2022] DELETE /identity/v3/projects/97a56c3d1e3c4d19b1dc011400c40f6d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:35.551037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:35.552841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:35.569962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:35.574709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1a440-9e1f-4b8f-858f-d2afcfff015e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:35.663200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:35.664091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:35.664591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:35.664982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] PATH_INFO: `/v3/users/e9b629821b5b4919bd6f79eac3ffe495` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:35.671938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b629821b5b4919bd6f79eac3ffe495)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:35.674855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:35.742903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b629821b5b4919bd6f79eac3ffe495'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.743660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b629821b5b4919bd6f79eac3ffe495'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.755313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b629821b5b4919bd6f79eac3ffe495'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.767269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b629821b5b4919bd6f79eac3ffe495'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.768165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5ada0549-6eb1-435e-82d9-66815e6da7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b629821b5b4919bd6f79eac3ffe495'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:35.797412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1200/2366] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:35 2022] DELETE /identity/v3/users/e9b629821b5b4919bd6f79eac3ffe495 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:36.166094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.167646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:36.188331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a2f2-3ac3-4e7b-aff6-c1f709ccd92e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.250636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.251324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.251770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.252049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] PATH_INFO: `/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.253321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5355799a4f4cb2b33f14d1aa7caa85)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.255302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.283143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.310503 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5355799a4f4cb2b33f14d1aa7caa85', 'request_id': 'req-b4e6eb6e-d175-469d-a97d-2b80d6289e48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:36.317885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5355799a4f4cb2b33f14d1aa7caa85', 'request_id': 'req-b4e6eb6e-d175-469d-a97d-2b80d6289e48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:36.324644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5355799a4f4cb2b33f14d1aa7caa85', 'request_id': 'req-b4e6eb6e-d175-469d-a97d-2b80d6289e48'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:36.338910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] The token cache is being invalidate because project 1d5355799a4f4cb2b33f14d1aa7caa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:36.339315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:36.340269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b4e6eb6e-d175-469d-a97d-2b80d6289e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:36.342441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1167/2367] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:36 2022] DELETE /identity/v3/projects/1d5355799a4f4cb2b33f14d1aa7caa85 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:36.347498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056156-1123-4532-955c-c93458eab005 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.347778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056156-1123-4532-955c-c93458eab005 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.348054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056156-1123-4532-955c-c93458eab005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.369274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-65056156-1123-4532-955c-c93458eab005 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:36.370488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-65056156-1123-4532-955c-c93458eab005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:36.477514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1201/2368] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:36.479371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.479756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.480120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.537985 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:36.539138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:36.548340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1168/2369] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:36.553159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056156-1123-4532-955c-c93458eab005 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.564161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056156-1123-4532-955c-c93458eab005 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.570039 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.570702 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.570979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.571265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.571925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:36.572311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.573977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.586474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1202/2370] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:36.593200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.603092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e3d6-e4d9-4b5c-adcb-803056eb7cc4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.608732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.609364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.609636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.609896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.610526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.612407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.642693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1169/2371] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:36.646825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.658044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c19a-03f3-4f7f-b30d-efcf4e1ccfa8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.669570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:36.773013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.774604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.775241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.775797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.777216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.780791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.812875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1203/2372] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:36 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:36.818055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.830483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae15b9-2650-48f1-89b8-b4fa68dbd7b8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.838677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.839638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.840616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.840616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.841652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.846776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.870545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1170/2373] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:36.873543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.891545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fecaf-fd59-4916-8d7b-6171f5fde76d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.899541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.900704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.902742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.903219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:36.904505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:36.907447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59548151-8fab-4ff7-bbf7-69666fd83ba1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:36.936127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1204/2374] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:36.938264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:36.956440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfabf-3134-4272-9189-9cc2a36bdfae admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:36.968274 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:36.969904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:36.970578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:36.971151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] PATH_INFO: `/v3/projects/3a82bb7386d74e17b4980c97192c6512/users/ea9973409318453c9875a5a9fe825c03/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.029649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a82bb7386d74e17b4980c97192c6512, user_id=ea9973409318453c9875a5a9fe825c03, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:37.032241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:37.053254 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1171/2375] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:36 2022] PUT /identity/v3/projects/3a82bb7386d74e17b4980c97192c6512/users/ea9973409318453c9875a5a9fe825c03/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:37.054848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309dfe-a40d-4404-95ac-cbd237a54e9a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.055292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309dfe-a40d-4404-95ac-cbd237a54e9a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.055602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3309dfe-a40d-4404-95ac-cbd237a54e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.078020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b3309dfe-a40d-4404-95ac-cbd237a54e9a None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:37.079986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b3309dfe-a40d-4404-95ac-cbd237a54e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:37.200626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1205/2376] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:37.212016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:37.214174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:37.386062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4d5a-5aae-4a32-b77d-ac00522cf1c9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:37.401988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:37.406639 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:37.407499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:37.409905 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:37.439207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:37.442208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:37.459588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1172/2377] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:38.325931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d711-705a-4d86-b104-a236c814e550 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:38.326494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d711-705a-4d86-b104-a236c814e550 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:38.326494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5d711-705a-4d86-b104-a236c814e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:38.359675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d7d5d711-705a-4d86-b104-a236c814e550 None None] MFA Rules not processed for user `ea9973409318453c9875a5a9fe825c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:38.361576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d7d5d711-705a-4d86-b104-a236c814e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:38.465400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1206/2378] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:38.477963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:38.479518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:38.575364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ea29-fcb5-4cd2-810c-21ef99f20ddc service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:38.582471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:38.583275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:38.583587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:38.583860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:38.590721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:38.596829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:38.598648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:38.615025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1173/2379] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:40.163786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3934a-15fe-4ea1-8837-60e0b351fc5d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:40.164366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3934a-15fe-4ea1-8837-60e0b351fc5d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:40.164624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3934a-15fe-4ea1-8837-60e0b351fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:40.185260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1bf3934a-15fe-4ea1-8837-60e0b351fc5d None None] MFA Rules not processed for user `ea9973409318453c9875a5a9fe825c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:40.186480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1bf3934a-15fe-4ea1-8837-60e0b351fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:40.193411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1207/2380] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:44.342586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:44.344721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:44.363758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9cd86-5fe3-493a-b6fb-1234ef3fe717 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:44.369511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:44.370310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:44.370681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:44.371338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] PATH_INFO: `/v3/users/cd88b469805b4e7bba0c6a9b42aee021` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:44.372806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd88b469805b4e7bba0c6a9b42aee021)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:44.375370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:44.530993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd88b469805b4e7bba0c6a9b42aee021'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:44.545961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd88b469805b4e7bba0c6a9b42aee021'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:44.564629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd88b469805b4e7bba0c6a9b42aee021'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:44.566011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd88b469805b4e7bba0c6a9b42aee021'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:44.566812 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd88b469805b4e7bba0c6a9b42aee021'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:44.587431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1174/2381] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:16:44 2022] DELETE /identity/v3/users/cd88b469805b4e7bba0c6a9b42aee021 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:44.595000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:44.595558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:44.595920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:44.623849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:44.626051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:44.647635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:44.781895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1208/2382] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:16:44.801862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:44.803672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:44.900227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17006-27e9-449c-b2d2-e85cab7e7552 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:44.910932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:44.912162 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:44.912466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:44.912732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:44.923478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:44.925179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f38662-3a17-41cf-9179-0dd1d7e92217 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:44.937554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1175/2383] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:45.995349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:45.997287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.010982 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be961194-bdf4-4491-85dc-e7c1d5afd8af None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.016253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.017040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.017364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.017687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] PATH_INFO: `/v3/projects/95e930c1a35841cfa123c9ad819978c4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.019187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e930c1a35841cfa123c9ad819978c4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.021438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.101700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e930c1a35841cfa123c9ad819978c4', 'request_id': 'req-03aaa38e-9051-4e97-b5f1-f07511b5f435'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:46.110144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e930c1a35841cfa123c9ad819978c4', 'request_id': 'req-03aaa38e-9051-4e97-b5f1-f07511b5f435'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:46.119709 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e930c1a35841cfa123c9ad819978c4', 'request_id': 'req-03aaa38e-9051-4e97-b5f1-f07511b5f435'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:46.136823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] The token cache is being invalidate because project 95e930c1a35841cfa123c9ad819978c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:16:46.137271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:46.138848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-03aaa38e-9051-4e97-b5f1-f07511b5f435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:16:46.140423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1209/2384] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:16:45 2022] DELETE /identity/v3/projects/95e930c1a35841cfa123c9ad819978c4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:46.147091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.147634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.147634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.171772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.172977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.257113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1176/2385] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:46.265516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.265799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.266250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.289800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.291028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.300333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1210/2386] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:46.304647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.316914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3d92-a16a-4b88-b6a6-3ab6e2d1221e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.322676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.323590 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.324244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.324720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.325784 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:16:46.326397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.328217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.333404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.350227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.363628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1177/2387] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:16:46.366939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd0be-b303-44ec-8f0b-2490d4f95b0e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.372912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.373554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.373826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.374103 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.375136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.377269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.421110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1211/2388] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:16:46.426560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.439191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0229b7-8bbf-4fd5-b2f7-8525d63e2447 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.558016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.558704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.558983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.559355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.560455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.562956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.601682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1178/2389] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:46.609057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.627382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb290-0eb9-407a-a99c-475f62b517dc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.633298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.634189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.634464 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.634887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.635705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.637753 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.662546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1212/2390] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:46.665334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.682136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5900-e343-4eed-9a34-746b85b18686 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.688830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.691139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.691970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.691970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.692602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.694390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22181c20-7a67-430a-bc16-66ee2b8aacdc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.710032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1179/2391] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:46.714190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.731035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578d5f7-4522-42f3-8894-2f28ee8f3157 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:46.736334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:46.737048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.737588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.737860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] PATH_INFO: `/v3/projects/3faeb4e2f06d4d2d811264955478547e/users/901e51998a164fa684f7532dae5fb240/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.777228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faeb4e2f06d4d2d811264955478547e, user_id=901e51998a164fa684f7532dae5fb240, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:46.777228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cf8f1-046d-4187-b610-451f2140eeb4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:46.787484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.787837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.788559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.793815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1213/2392] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:46 2022] PUT /identity/v3/projects/3faeb4e2f06d4d2d811264955478547e/users/901e51998a164fa684f7532dae5fb240/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:16:46.799204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43943-ac74-4326-8d84-3396553033ba None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:46.799549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43943-ac74-4326-8d84-3396553033ba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:46.799951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c43943-ac74-4326-8d84-3396553033ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:46.816534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] MFA Rules not processed for user `cc68601c71074f1b86b9698193289f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.817977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.827513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19c43943-ac74-4326-8d84-3396553033ba None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:46.828703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19c43943-ac74-4326-8d84-3396553033ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:46.891567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:46.900737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1180/2393] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:46.949362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1214/2394] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:46.957092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:46.958991 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.064099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb8622-8eef-4473-927d-fcc9903d6e0e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:47.068146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:47.068994 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.069275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.069552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.096722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:47.099032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:47.124128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1181/2395] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:16:47.603743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f70e6-a459-4065-b6c7-c71a6e0236d8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:47.605927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f70e6-a459-4065-b6c7-c71a6e0236d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:47.606582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f70e6-a459-4065-b6c7-c71a6e0236d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:47.651155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c46f70e6-a459-4065-b6c7-c71a6e0236d8 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:47.657315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c46f70e6-a459-4065-b6c7-c71a6e0236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.766111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1215/2396] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:47.864007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:47.865543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:47.971833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:48.037023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94647d-e317-4cc4-9e77-ce76d2404d81 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:48.045806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:48.047417 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.047908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.048395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:48.066069 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:48.069769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:48.087689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1182/2397] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:16:48.986762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ff52-7841-44f2-9492-9178a1c289b2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:48.987342 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ff52-7841-44f2-9492-9178a1c289b2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:48.987572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2ff52-7841-44f2-9492-9178a1c289b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.031607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3ec2ff52-7841-44f2-9492-9178a1c289b2 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:49.036504 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3ec2ff52-7841-44f2-9492-9178a1c289b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:49.058191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1216/2398] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:49.073930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:49.099959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebe60-b97a-4d64-b32f-7d8c66e2a0b5 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:49.113306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:49.113937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:49.114214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:49.114482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:49.135097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:49.137236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:49.148159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1183/2399] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:16:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:16:57.769474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:57.770101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:57.770101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:57.852783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] MFA Rules not processed for user `901e51998a164fa684f7532dae5fb240`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:16:57.861036 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:16:58.091607 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1217/2400] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:16:58.095932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.140526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4f97d-290e-4d90-93b6-c519f87dd0cb service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.153630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.154394 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.154675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.154942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.155581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.157616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.264653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.266228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1184/2401] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:16:58 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:58.283511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e4e7-1509-4d1f-8ae5-47ad95e95bdc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.632664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.633326 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.633609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.633897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.634529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.636865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.667312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:16:58.703468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.704818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1218/2402] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:16:58 2022] POST /identity/v3/users => generated 292 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:16:58.719570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bf8-8877-4040-a313-03f99f068e36 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.730914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.731576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.731855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.732125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.732881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.734506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.756893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1185/2403] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:16:58.761013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.779228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e475b1-e960-4ed8-9a2b-7853c9910159 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:58.796052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:58.796736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:58.797045 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:58.797321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] PATH_INFO: `/v3/projects/cbe17980d60b463dae972bb6d314b38f/users/b655dd3caed4403a8850abd3ed11ed2c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:58.825695 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe17980d60b463dae972bb6d314b38f, user_id=b655dd3caed4403a8850abd3ed11ed2c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:58.838457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:58.880280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:58.880716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1219/2404] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:58 2022] PUT /identity/v3/projects/cbe17980d60b463dae972bb6d314b38f/users/b655dd3caed4403a8850abd3ed11ed2c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:16:58.892559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a54294-8ad7-4bfa-8ea2-5ca0c648f545 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:59.006794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:59.007795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.010204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.011670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.013067 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:59.021175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221480-e67c-40c8-8fd4-9bf1a40067a2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:59.064679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:16:59.070755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1186/2405] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:16:59.076942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a0227-535b-4694-8264-11eae0ee7248 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:16:59.091305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:16:59.091971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:16:59.092371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:16:59.092646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] PATH_INFO: `/v3/projects/cbe17980d60b463dae972bb6d314b38f/users/b655dd3caed4403a8850abd3ed11ed2c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:16:59.098407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe17980d60b463dae972bb6d314b38f, user_id=b655dd3caed4403a8850abd3ed11ed2c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:16:59.101115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:16:59.124066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1220/2406] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:16:59 2022] PUT /identity/v3/projects/cbe17980d60b463dae972bb6d314b38f/users/b655dd3caed4403a8850abd3ed11ed2c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:17:09.052219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:09.120119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=4,keystone:SELECT=17 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:12.119007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.120209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.121148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.208995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] MFA Rules not processed for user `b655dd3caed4403a8850abd3ed11ed2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:12.212164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:12.414924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1187/2407] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:12.415906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:12.418345 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:12.550967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b066f12-ab26-4514-8a9e-bdfe309cbb5d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:12.558025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:12.559337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:12.559617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:12.559899 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:12.634904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:12.637165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9743ec-127c-462d-ab33-d90816f20a98 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:12.655181 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1221/2408] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:14.823444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:14.825843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:15.004366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42bee4-ba01-4432-bdb7-c18c897558ca None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:15.013504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:15.018807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:15.019360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:15.019737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:15.024587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:15.070586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:15.073212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c49e4-3b27-4428-95aa-8a55ef011b8a service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:15.109003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1188/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:15.441860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c4ea-ef8f-4dde-b3c2-25c7905d1868 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:15.444421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c4ea-ef8f-4dde-b3c2-25c7905d1868 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:15.445825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c4ea-ef8f-4dde-b3c2-25c7905d1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:15.546237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c28c4ea-ef8f-4dde-b3c2-25c7905d1868 None None] MFA Rules not processed for user `901e51998a164fa684f7532dae5fb240`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:15.547897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c28c4ea-ef8f-4dde-b3c2-25c7905d1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:15.558169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1222/2410] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:18.000237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.001585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.002316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.004981 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1189/2411] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:17:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:18.013469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae618ba-26bd-40c5-9fcb-243775d70db1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:18.014128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae618ba-26bd-40c5-9fcb-243775d70db1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:18.014128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae618ba-26bd-40c5-9fcb-243775d70db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:18.049100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fae618ba-26bd-40c5-9fcb-243775d70db1 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:18.050882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fae618ba-26bd-40c5-9fcb-243775d70db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:18.069765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1223/2412] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:17:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:20.120191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.122715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:20.201234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419c55-ac56-467a-b61a-853e2b1c0fe1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.205685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.206311 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.206698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.206838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.218717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.220172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513d6cd-1520-4d1b-85ba-a2883690c074 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.232918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1190/2413] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:20.344575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.345292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.345400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.347135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1224/2414] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:20.353109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a404-0e36-4762-b1be-1ca6d2656a52 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.353530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a404-0e36-4762-b1be-1ca6d2656a52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.353895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a404-0e36-4762-b1be-1ca6d2656a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.379044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a3a7a404-0e36-4762-b1be-1ca6d2656a52 None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:20.380307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a3a7a404-0e36-4762-b1be-1ca6d2656a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:20.394090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:20.439993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1191/2415] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:17:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:20.462970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.464843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:20.481258 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b27da-7245-4054-8b3b-49b02f0027f6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.486630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.487769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.488213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.488644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.501312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.502970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ce10b-3c99-4e4a-ae03-b117388ac91d service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.519119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1225/2416] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:17:20.696244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435e8f-017d-48e2-9d82-e276575a7e85 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.696868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435e8f-017d-48e2-9d82-e276575a7e85 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.697369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8435e8f-017d-48e2-9d82-e276575a7e85 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.700202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1192/2417] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:17:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:17:20.707475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207fe8-1f24-426f-9d36-a70079a220f8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.707789 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207fe8-1f24-426f-9d36-a70079a220f8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.708156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33207fe8-1f24-426f-9d36-a70079a220f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.746713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-33207fe8-1f24-426f-9d36-a70079a220f8 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:20.750127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33207fe8-1f24-426f-9d36-a70079a220f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:20.767429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1226/2418] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:17:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:17:20.791556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8435e8f-017d-48e2-9d82-e276575a7e85 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:20.843902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8435e8f-017d-48e2-9d82-e276575a7e85 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:20.853615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:20.855770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:20.856716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:20.857510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:20.883788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:20.887388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:20.913472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1193/2419] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:21.313731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.314064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.314338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.334807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:21.336034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:21.472010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1227/2420] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:17:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:17:21.491521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:21.614559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974943-f939-434f-9eb9-91fdcb6ffdba service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:21.623492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:21.624594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:21.625169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:21.625710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:21.642353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:21.644122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:21.658090 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1194/2421] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:24.242318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.244052 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:24.260143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:24.362642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557a94-3034-465a-86e9-ceb4d337a320 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.368284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.369069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.369349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.369623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] PATH_INFO: `/v3/users/f062d87e5ab84dff99ffcaaa730efd41` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.371806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f062d87e5ab84dff99ffcaaa730efd41)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.374423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:24.441307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f062d87e5ab84dff99ffcaaa730efd41'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:24.442061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f062d87e5ab84dff99ffcaaa730efd41'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:24.464863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f062d87e5ab84dff99ffcaaa730efd41'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:24.481298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f062d87e5ab84dff99ffcaaa730efd41'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:24.481947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-65e6dafa-4cc0-4926-b198-3d0fc0d1cd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f062d87e5ab84dff99ffcaaa730efd41'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:24.513727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1228/2422] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:17:24 2022] DELETE /identity/v3/users/f062d87e5ab84dff99ffcaaa730efd41 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:24.834065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:24.858436 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549cc36-b329-42b0-bafa-644411f370d7 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:24.956182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:24.957154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:24.957666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:24.958115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] PATH_INFO: `/v3/projects/7d4b78b5754042bfb4a51e9b50e5e24e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:24.964596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4b78b5754042bfb4a51e9b50e5e24e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:24.965930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.037995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:25.042615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4b78b5754042bfb4a51e9b50e5e24e', 'request_id': 'req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:25.051838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4b78b5754042bfb4a51e9b50e5e24e', 'request_id': 'req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:25.061264 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4b78b5754042bfb4a51e9b50e5e24e', 'request_id': 'req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:25.081913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] The token cache is being invalidate because project 7d4b78b5754042bfb4a51e9b50e5e24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:17:25.082116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:25.082764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53ef80a2-d5e4-413e-9249-c3a6e20a4ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:17:25.084272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1195/2423] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:17:24 2022] DELETE /identity/v3/projects/7d4b78b5754042bfb4a51e9b50e5e24e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:17:25.090097 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.090376 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.090649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.113061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.114325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.187569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1229/2424] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:25.196367 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.196862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.197256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.226627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.228196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.242256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1196/2425] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:25.247099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.258092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015bac3-a9b2-49a0-abba-28c5812b1f79 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.262994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.263616 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.263892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.264162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.264850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:17:25.265153 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.266771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.281082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1230/2426] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:17:25.285458 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.301115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3d2a-e1d3-46c6-ae1a-22686945fc67 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.306301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.306914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.307181 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.307613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.308255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.310233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.341727 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1197/2427] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:25.346410 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.357685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea407-e92e-4d29-ab0e-9948bbe74452 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.372686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:25.431077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.431701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.431977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.432293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.433277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.435236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.466177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1231/2428] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:25.467410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.479166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02465-285b-44c2-a4c5-7a9df754adf0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.485218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.485862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.486140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.486411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.487077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.488725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.501803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1198/2429] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:17:25.506532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.517741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aeb1b-cc0e-470e-bdd7-da802cf1f603 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.523442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.524054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.524320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.524573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.525250 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.527238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185775b-ecd9-4e47-8c40-26dc5a49fb33 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.538713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1232/2430] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:17:25.544308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.556021 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d33730-be12-4a0e-8157-aba26595bfc3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.562206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.562899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.563165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.565261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] PATH_INFO: `/v3/projects/046c7a36e34b45f09c8cc876e2fd9967/users/db988f456a2c48c2a2acd1b2b12d5aed/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.580811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046c7a36e34b45f09c8cc876e2fd9967, user_id=db988f456a2c48c2a2acd1b2b12d5aed, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.583617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.611765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1199/2431] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:17:25 2022] PUT /identity/v3/projects/046c7a36e34b45f09c8cc876e2fd9967/users/db988f456a2c48c2a2acd1b2b12d5aed/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:25.618004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ee0d-5a16-4ba0-b09b-8bf0d6c8e882 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.618285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ee0d-5a16-4ba0-b09b-8bf0d6c8e882 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.618555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2ee0d-5a16-4ba0-b09b-8bf0d6c8e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.643875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-85c2ee0d-5a16-4ba0-b09b-8bf0d6c8e882 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:25.645184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-85c2ee0d-5a16-4ba0-b09b-8bf0d6c8e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.728662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1233/2432] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:25.739287 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:25.741449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:25.812673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a2f0e-0e2b-4d53-8ce6-ecb844363197 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:25.816937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:25.817555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:25.817830 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:25.818099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:25.828855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:25.830381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:25.842755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1200/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:26.617530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25367-4c14-47b6-b66d-b03d640a5aa2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.618117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25367-4c14-47b6-b66d-b03d640a5aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.618235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25367-4c14-47b6-b66d-b03d640a5aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.641509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-15d25367-4c14-47b6-b66d-b03d640a5aa2 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:26.642820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-15d25367-4c14-47b6-b66d-b03d640a5aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:26.729392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1234/2434] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:17:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:26.746330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:26.749146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:26.877066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b09a-1601-45ab-9f1f-4c0304f9251a service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:26.882813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:26.884034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:26.884465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:26.884937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:26.894912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:26.896876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:26.906824 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1201/2435] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:33.887315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:33.888100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:33.888100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:33.966135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] MFA Rules not processed for user `db988f456a2c48c2a2acd1b2b12d5aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:33.967718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:34.024825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.130022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1235/2436] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:34.130250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.144667 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:34.156455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d1d1-794d-4301-8b29-2ac3b69bd4b0 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.168204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.169347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.169493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.169679 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.170511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.172808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.233118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1202/2437] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:17:34 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:34.237322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.252120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d30cd4-328d-41c4-8df0-be9b426e4a89 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.352818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406421-b42e-407e-826f-352475450387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.353683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406421-b42e-407e-826f-352475450387 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.353981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406421-b42e-407e-826f-352475450387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.354244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe406421-b42e-407e-826f-352475450387 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.355923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406421-b42e-407e-826f-352475450387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.358004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe406421-b42e-407e-826f-352475450387 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.398188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1236/2438] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:17:34 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:17:34.404166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.416019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464475ce-82d3-4d38-8688-09f00ad8f68b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.423601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.424331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.424919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.425192 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.426091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.428305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.457735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1203/2439] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:17:34.461910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406421-b42e-407e-826f-352475450387 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.475287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe406421-b42e-407e-826f-352475450387 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.482347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.483200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.483480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.483752 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] PATH_INFO: `/v3/projects/ff1ce2b3cf904757a783a154a126dd46/users/c1971a5dc3d64b189898c2eaa227db9c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.510693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1ce2b3cf904757a783a154a126dd46, user_id=c1971a5dc3d64b189898c2eaa227db9c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.519768 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.546574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1237/2440] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:17:34 2022] PUT /identity/v3/projects/ff1ce2b3cf904757a783a154a126dd46/users/c1971a5dc3d64b189898c2eaa227db9c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:17:34.550995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.567541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec4e6-c983-4cf1-ba83-4accda981e5f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.756253 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.756939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.757218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.757489 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.758206 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.763798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba57ac-a719-4a52-95d9-5e0a5e4063a1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.794034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1204/2441] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:17:34.799777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:34.835997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864c01d-3820-41e9-850b-6901b14036c1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:34.843825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:34.844774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:34.845273 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:34.845551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] PATH_INFO: `/v3/projects/ff1ce2b3cf904757a783a154a126dd46/users/c1971a5dc3d64b189898c2eaa227db9c/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:34.855335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1ce2b3cf904757a783a154a126dd46, user_id=c1971a5dc3d64b189898c2eaa227db9c, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:34.858232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:34.871794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1238/2442] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:17:34 2022] PUT /identity/v3/projects/ff1ce2b3cf904757a783a154a126dd46/users/c1971a5dc3d64b189898c2eaa227db9c/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:17:41.883045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b98fed-af1c-4f47-b522-de4d02e16b79 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:41.883611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b98fed-af1c-4f47-b522-de4d02e16b79 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:41.887153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b98fed-af1c-4f47-b522-de4d02e16b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:41.990119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-85b98fed-af1c-4f47-b522-de4d02e16b79 None None] MFA Rules not processed for user `c1971a5dc3d64b189898c2eaa227db9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:41.991380 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85b98fed-af1c-4f47-b522-de4d02e16b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:42.167057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1205/2443] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:42.177973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:42.185232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:42.268723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed35b7-707a-4871-9523-37c04f04563e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:42.273316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:42.273832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.274098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.274539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.363274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.399004 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:42.401904 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:42.426118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1239/2444] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:42.731128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc25f7-f928-4995-9eac-534918348c31 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:42.731428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc25f7-f928-4995-9eac-534918348c31 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:42.731706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc25f7-f928-4995-9eac-534918348c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:42.763508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-82fc25f7-f928-4995-9eac-534918348c31 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:42.768324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-82fc25f7-f928-4995-9eac-534918348c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:42.895262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:42.921721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1206/2445] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:42.942158 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:43.054734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6954f-25f2-4186-afdc-5b51b18a2f0b service glance] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.064049 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.065072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.065475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.065861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.080823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.084194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.103092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1240/2446] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:43.331999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f38104-161c-470a-80a2-137d89b0cddb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.333070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f38104-161c-470a-80a2-137d89b0cddb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.333552 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f38104-161c-470a-80a2-137d89b0cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.393491 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-43f38104-161c-470a-80a2-137d89b0cddb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:43.396086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-43f38104-161c-470a-80a2-137d89b0cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:43.507821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1207/2447] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:43.544508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:43.547619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:43.637615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e66c-ccf8-440e-b587-2dd155534992 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:43.646319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:43.647053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:43.647437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:43.647799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:43.669839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:43.672475 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:43.698331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1241/2448] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:47.689608 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4c48-e7fe-45f3-8737-d0a6b7cf74a8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.690255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4c48-e7fe-45f3-8737-d0a6b7cf74a8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.690255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4c48-e7fe-45f3-8737-d0a6b7cf74a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.716724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-590a4c48-e7fe-45f3-8737-d0a6b7cf74a8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:47.718184 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-590a4c48-e7fe-45f3-8737-d0a6b7cf74a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:47.731265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1208/2449] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:47.758271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:47.772935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b74de-bad5-4ec3-b9a3-21a4415ac62f service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:47.779655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:47.780469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.780976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.781244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.794498 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:47.797121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:47.832644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1242/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:47.848116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb6f9-5cd0-492a-92e8-33dd72324b37 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:47.849210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb6f9-5cd0-492a-92e8-33dd72324b37 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:47.849651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eb6f9-5cd0-492a-92e8-33dd72324b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:47.889124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-419eb6f9-5cd0-492a-92e8-33dd72324b37 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:47.890570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-419eb6f9-5cd0-492a-92e8-33dd72324b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:47.905698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1209/2451] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:17:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:47.981541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:48.007889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37dbef-0bba-43c9-8fe8-c89dd3947855 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:48.018805 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:48.019356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:48.021540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:48.021808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:48.042651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:48.045384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:48.067225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1243/2452] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:17:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:17:51.182648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838b2f-4939-4c34-8187-a6f69b356bdd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.183723 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838b2f-4939-4c34-8187-a6f69b356bdd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.184228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838b2f-4939-4c34-8187-a6f69b356bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.218601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-63838b2f-4939-4c34-8187-a6f69b356bdd None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:51.222460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-63838b2f-4939-4c34-8187-a6f69b356bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:51.238495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1210/2453] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:17:51.282508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:51.286254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:51.318756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da3a7d-3a3f-40bc-884b-19de235aba2a service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:51.330525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:51.335199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:51.336093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:51.336825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:51.360651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:51.364078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce0df-834e-4b3a-85c2-45dbe49e33d4 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:51.386979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1244/2454] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:54.206149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d82-e154-47de-b623-3582b01196ee None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:54.206668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d82-e154-47de-b623-3582b01196ee None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:54.206668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d82-e154-47de-b623-3582b01196ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:54.227811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e9609d82-e154-47de-b623-3582b01196ee None None] MFA Rules not processed for user `db988f456a2c48c2a2acd1b2b12d5aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:54.229597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e9609d82-e154-47de-b623-3582b01196ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:54.236694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1211/2455] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:17:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:55.364422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c262-8331-4e16-9fef-fca44b2d761f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.365102 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c262-8331-4e16-9fef-fca44b2d761f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.365808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c262-8331-4e16-9fef-fca44b2d761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.397327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a40c262-8331-4e16-9fef-fca44b2d761f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:55.398729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a40c262-8331-4e16-9fef-fca44b2d761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:55.407450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1245/2456] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:55.431081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609d82-e154-47de-b623-3582b01196ee None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:55.446391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609d82-e154-47de-b623-3582b01196ee None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:55.454028 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:55.454771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:55.455224 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:55.455496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:55.467289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:55.469949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:55.483737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1212/2457] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:17:59.593812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.594647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.594850 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.604871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:17:59.620238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:17:59.621851 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:17:59.634091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1246/2458] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:17:59.661439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:17:59.685216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ceb2b-4479-4167-ba7d-87ddf7859a2e service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:17:59.694158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:17:59.695208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:17:59.695629 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:17:59.696156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:17:59.711640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:17:59.715708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59586e8-11b6-482a-8a5f-3d504e5f745f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:17:59.729452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1213/2459] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:00.572601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:00.649440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0cd9b-6b94-4b8c-a9df-84abbf336b74 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:00.654205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:00.654857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:00.655172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:00.655440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:00.658146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:00.734667 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:00.736042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:00.747902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1247/2460] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:02.370816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6977-65e5-4993-b1d2-0a53d11f19c0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.371634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6977-65e5-4993-b1d2-0a53d11f19c0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.371634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d6977-65e5-4993-b1d2-0a53d11f19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.399493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-893d6977-65e5-4993-b1d2-0a53d11f19c0 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:02.401564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-893d6977-65e5-4993-b1d2-0a53d11f19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:02.410782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1214/2461] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:18:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:02.425221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:02.438286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386be3-a4ec-4c85-877c-62f6892f4cfd service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:02.444188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:02.445529 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:02.445994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:02.446467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:02.457067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:02.458728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:02.468995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1248/2462] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:18:03.846259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731d3-8e5f-4a20-bab4-503145fa3e52 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.847525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731d3-8e5f-4a20-bab4-503145fa3e52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.847694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f731d3-8e5f-4a20-bab4-503145fa3e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.887056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f7f731d3-8e5f-4a20-bab4-503145fa3e52 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:03.888858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7f731d3-8e5f-4a20-bab4-503145fa3e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:03.898098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1215/2463] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:03.924767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:03.938190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee5d1-d640-43d1-ac2e-f09af8b8b598 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:03.945341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:03.946510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:03.947591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:03.948167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:03.958639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:03.960237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:03.972434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1249/2464] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:13.867669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=59 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:13.967952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=63 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:33.281094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9f3-c1e8-486d-92c6-48cf3f237f55 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:33.281633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9f3-c1e8-486d-92c6-48cf3f237f55 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:33.281633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e9f3-c1e8-486d-92c6-48cf3f237f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:33.306591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-df36e9f3-c1e8-486d-92c6-48cf3f237f55 None None] MFA Rules not processed for user `ea9973409318453c9875a5a9fe825c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:33.307960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-df36e9f3-c1e8-486d-92c6-48cf3f237f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:33.384092 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1216/2465] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:34.022576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:34.024076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:34.037116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4366-481a-496e-81f4-cc973941b2cd service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:34.042516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:34.043169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:34.043448 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:34.043754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:34.053824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:34.055465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c838b9-80c6-4f07-8b79-5b6093afa62e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:34.067245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1250/2466] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:43.376320 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=25 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:44.062613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:44.091778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d47d-e32d-41cd-89e3-63e058101f4f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:44.092145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d47d-e32d-41cd-89e3-63e058101f4f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:44.092486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d47d-e32d-41cd-89e3-63e058101f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:44.119114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2bd0d47d-e32d-41cd-89e3-63e058101f4f None None] MFA Rules not processed for user `e3cc61673b284d8dae02a659a6635adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:44.120455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2bd0d47d-e32d-41cd-89e3-63e058101f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:44.189063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1217/2467] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:18:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:46.325282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:46.325881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:46.325881 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:46.346783 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] MFA Rules not processed for user `cc68601c71074f1b86b9698193289f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:46.348125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:46.428871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1251/2468] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:18:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:54.181573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=25 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:18:55.047406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da54-b216-4255-b875-4cd38b43fadf None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.047640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da54-b216-4255-b875-4cd38b43fadf None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.047875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596da54-b216-4255-b875-4cd38b43fadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.068925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d596da54-b216-4255-b875-4cd38b43fadf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:55.070516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d596da54-b216-4255-b875-4cd38b43fadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:55.079058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1218/2469] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:55.101251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:55.115535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4d44b-dab4-4856-94ef-0a2c18bee0a9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:55.121712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:55.122346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:55.122604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:55.122855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:55.131987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:55.133775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:55.144635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1252/2470] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:18:58.365257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba000d-2cdd-4920-80b4-6e7dbf8e73ce None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.365821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba000d-2cdd-4920-80b4-6e7dbf8e73ce None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.365821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba000d-2cdd-4920-80b4-6e7dbf8e73ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.387365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-49ba000d-2cdd-4920-80b4-6e7dbf8e73ce None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:18:58.388644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-49ba000d-2cdd-4920-80b4-6e7dbf8e73ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:18:58.397821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1219/2471] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:18:58.437253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:18:58.452231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f567ab-eb0f-47e2-9af6-8b26910120e9 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:18:58.462519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:18:58.463447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:18:58.463883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:18:58.464282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:18:58.476664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:18:58.479412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:18:58.493725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1253/2472] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:01.445936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.446800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.446800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.468381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:01.469654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:01.479198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1220/2473] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:19:01.526255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:01.538807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b1e9-66b1-4211-a31f-3702f9e24e0b service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:01.545976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:01.546622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:01.546970 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:01.547225 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:01.558815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:01.560396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f665-4104-415c-9abf-7773d73dcefb service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:01.570435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1254/2474] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:08.329970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:08.342390 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7fae1-4918-4b6b-ad38-8063f306bddb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:08.349085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:08.350063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:08.350544 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:08.350980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:08.354706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:08.374107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:08.375547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:08.387218 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1221/2475] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:08.769157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098e28-4387-4d46-ab06-7fe2a2aeedb7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:08.769659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098e28-4387-4d46-ab06-7fe2a2aeedb7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:08.769659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098e28-4387-4d46-ab06-7fe2a2aeedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:08.791034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-82098e28-4387-4d46-ab06-7fe2a2aeedb7 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:08.792263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-82098e28-4387-4d46-ab06-7fe2a2aeedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:08.801246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1255/2476] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:19:08.824108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:08.836168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba69350-5aca-421e-889c-5fb4d57897b6 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:08.843310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:08.843914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:08.844161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:08.844454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:08.854343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:08.855892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:08.866686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1222/2477] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:11.760999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddab6f-201c-4e75-93dc-14043d0c2645 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:11.761565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddab6f-201c-4e75-93dc-14043d0c2645 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:11.761860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddab6f-201c-4e75-93dc-14043d0c2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:11.783761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-76ddab6f-201c-4e75-93dc-14043d0c2645 None None] MFA Rules not processed for user `2f6fbce6c07145b1815510bf9b8f2049`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:11.785057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-76ddab6f-201c-4e75-93dc-14043d0c2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:11.853617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1256/2478] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:19:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:19:11.892935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:11.906414 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f0f3-2a4e-4ac3-9841-5e95a042e7c6 service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:11.913755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:11.917834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:11.918363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:11.918720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:11.920851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:11.937426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:11.938873 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:11.950404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1223/2479] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:11.969449 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:11.969740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:11.969992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:11.992282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:19:11.993668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:12.002310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1257/2480] 10.222.0.83 () {58 vars in 1016 bytes} [Mon Aug 29 20:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:19:12.034306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:12.046292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824563a-45e7-4b46-bf12-9a1e50d24481 service glance] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:12.052449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:12.053228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:12.053605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:12.053958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:12.065657 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:12.067696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:12.078715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1224/2481] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:21.986347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=74 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:22.073742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=33 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:24.273443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:24.288129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878309e-f59b-435c-a187-d52f8fca2d05 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:24.295116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:24.295725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:24.295974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:24.296249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:24.298416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:24.310997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:24.312620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:24.322513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1258/2482] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:34.317749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:35.393823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:35.396099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:35.459416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37630b-7f1a-4e7c-b8bc-d92ae9d527b5 service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:35.464102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:35.464633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:35.464938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:35.465207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:35.467139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:35.481323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:35.483055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:35.492736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1225/2483] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:43.125128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:43.126937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:43.143620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638198ce-e9d0-46d3-95d2-94789629212f service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:43.149588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:43.150902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:43.151565 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:43.151958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] PATH_INFO: `/v3/users/ea9973409318453c9875a5a9fe825c03` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:43.153413 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9973409318453c9875a5a9fe825c03)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:43.155405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:43.212599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9973409318453c9875a5a9fe825c03'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.213428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9973409318453c9875a5a9fe825c03'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.221453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9973409318453c9875a5a9fe825c03'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.233085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9973409318453c9875a5a9fe825c03'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.233722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9973409318453c9875a5a9fe825c03'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.258050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1259/2484] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:19:43 2022] DELETE /identity/v3/users/ea9973409318453c9875a5a9fe825c03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:43.458273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:43.482508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236dae-e202-4b80-b817-b6358d91118e service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:43.563564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:43.564153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:43.564465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:43.564735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] PATH_INFO: `/v3/projects/3a82bb7386d74e17b4980c97192c6512` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:43.566116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a82bb7386d74e17b4980c97192c6512)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:43.568163 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:43.630157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a82bb7386d74e17b4980c97192c6512', 'request_id': 'req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.639377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a82bb7386d74e17b4980c97192c6512', 'request_id': 'req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.650870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a82bb7386d74e17b4980c97192c6512', 'request_id': 'req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.683619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] The token cache is being invalidate because project 3a82bb7386d74e17b4980c97192c6512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:19:43.683913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.684595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:19:43.686257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1226/2485] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:19:43 2022] DELETE /identity/v3/projects/3a82bb7386d74e17b4980c97192c6512 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:19:50.251168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:50.252364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:50.333297 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497e24b-6854-4c6e-b7a6-a1ea8afa2ace admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:50.419397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:50.420442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:50.420950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:50.421365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:50.423612 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:50.432797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:50.491792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:50.493542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:50.504034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1260/2486] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:19:53.679378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:19:57.373666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:19:57.376305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:57.441437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dff6d-95f0-4d90-9842-05dc0a1dea6e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:19:57.446164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:19:57.446806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:19:57.447142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:19:57.447680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:19:57.450714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:19:57.534897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:19:57.536511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:19:57.548354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1227/2487] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:00.498927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=24 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:01.360510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:01.364916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:01.382944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14626183-91c2-475d-b4cc-2398b10843c3 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:01.387952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:01.388603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.388912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.389179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] PATH_INFO: `/v3/users/cc68601c71074f1b86b9698193289f92` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.390359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc68601c71074f1b86b9698193289f92)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:01.392344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:01.448128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc68601c71074f1b86b9698193289f92'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.448951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc68601c71074f1b86b9698193289f92'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.456643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc68601c71074f1b86b9698193289f92'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.467830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc68601c71074f1b86b9698193289f92'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.468883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6235a1dd-189a-4afd-abf8-b88e9cd59d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc68601c71074f1b86b9698193289f92'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.492573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1261/2488] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:01 2022] DELETE /identity/v3/users/cc68601c71074f1b86b9698193289f92 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:01.714726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:01.727426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918905-1217-42e7-9a73-d47ab54e1116 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:01.791037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:01.791668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.791945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.792219 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] PATH_INFO: `/v3/projects/f6cdc9e973c2453ca579483b372ddb7a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.793438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cdc9e973c2453ca579483b372ddb7a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:01.795361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:01.849293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cdc9e973c2453ca579483b372ddb7a', 'request_id': 'req-85d8ec25-b26f-405c-af0b-f046fa3cf02c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.852034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:01.857955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cdc9e973c2453ca579483b372ddb7a', 'request_id': 'req-85d8ec25-b26f-405c-af0b-f046fa3cf02c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.864907 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cdc9e973c2453ca579483b372ddb7a', 'request_id': 'req-85d8ec25-b26f-405c-af0b-f046fa3cf02c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.879455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] The token cache is being invalidate because project f6cdc9e973c2453ca579483b372ddb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:01.879779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.880476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85d8ec25-b26f-405c-af0b-f046fa3cf02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:01.882328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1228/2489] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:01 2022] DELETE /identity/v3/projects/f6cdc9e973c2453ca579483b372ddb7a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:01.887441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:01.887941 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:01.888051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:01.919021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:01.919701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:01.994731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1262/2490] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:02.003342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.003654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.003982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.027942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:02.029318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:02.040862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1229/2491] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:02.046701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.065581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d4d45-98f7-482f-ae99-547bde7247d5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.073104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.074001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.074390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.074621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.075322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:20:02.075670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.077569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.092249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1263/2492] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:02.096566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.107572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f15ea-00e1-4978-956c-531aa74c5b0f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.114039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.114765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.115104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.115383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.116310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.118605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.158655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1230/2493] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:02.164310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.176243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8b51-8575-4a56-a3a7-716c352b3435 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.250339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.250979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.251285 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.251630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.252323 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.254403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.263600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:02.282527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1264/2494] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:02 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:02.286951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.298047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bd57-b6b1-4ebd-b908-0a97cb07e585 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.304370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.305024 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.305283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.305555 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.306195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.307805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.318511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1231/2495] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:02.323415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.334176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5321f-15de-4012-a42f-3042b7c53ec2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.340581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.341221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.341479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.341747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.342797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.343980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19584b7f-e941-403a-beb2-cdd20d67a68d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.356635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1265/2496] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:02.361246 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.372715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1ef3-77d8-44d1-bc38-87b45068c7f5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.377851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.378517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.378792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.379056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] PATH_INFO: `/v3/projects/d489f6978f24455c98da42932e4c2f6e/users/5baeae00a21f4b26b7ede28c998b31bb/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.395071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d489f6978f24455c98da42932e4c2f6e, user_id=5baeae00a21f4b26b7ede28c998b31bb, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.397866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.413953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1232/2497] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:02 2022] PUT /identity/v3/projects/d489f6978f24455c98da42932e4c2f6e/users/5baeae00a21f4b26b7ede28c998b31bb/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:02.419551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed823d7-9379-45a6-9555-062816ad7952 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.419833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed823d7-9379-45a6-9555-062816ad7952 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.420104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed823d7-9379-45a6-9555-062816ad7952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.441830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0ed823d7-9379-45a6-9555-062816ad7952 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:02.443202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0ed823d7-9379-45a6-9555-062816ad7952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:02.513379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1266/2498] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:02.524919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:02.526757 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:02.606523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbd136-3ffd-4d36-9a05-767f7953c901 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:02.611098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:02.611717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:02.611998 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:02.612250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:02.623086 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:02.624533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:02.635482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1233/2499] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:07.309903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:07.310653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:07.310653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:07.362263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] MFA Rules not processed for user `5baeae00a21f4b26b7ede28c998b31bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:07.363624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:07.455782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1267/2500] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:07.466383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:07.468438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:07.571937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c5414-434b-4edb-ad39-b5f8ca793867 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:07.578825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:07.579463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:07.579738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:07.580008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:07.590800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:07.592434 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fddf43-1496-46af-964e-c06ac3f1022b service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:07.604437 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1234/2501] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:08.745573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:08.759916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997bee-d2be-4502-abfc-a8322e00ea5d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:08.763940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:08.764564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:08.764877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:08.765147 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:08.767380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:08.778543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:08.779990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:08.793788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1268/2502] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:09.207003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:09.207490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:09.207662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:09.218113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:09.232915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] MFA Rules not processed for user `5baeae00a21f4b26b7ede28c998b31bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:09.235118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:09.247914 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1235/2503] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:09.735356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:09.747897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed5ed9-55ac-4ef6-ab38-2da220c4f3e3 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:09.753663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:09.754416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:09.754787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:09.755174 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:09.757606 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:09.769279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:09.770997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:09.781355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1269/2504] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:20:10.155210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:10.156782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:10.247546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ffc76-94bb-4d74-bf6b-afea9a06f79c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:10.253612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:10.254235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:10.254513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:10.254787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:10.256794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:10.268936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:10.270556 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:10.281899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1236/2505] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:13.969975 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:13.971613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:14.000734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea08c33-7ab7-4baf-98bc-3318cf8ab0f1 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:14.008871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:14.009924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:14.010433 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:14.010930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:14.013713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:14.028194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:14.031493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04919bb3-3b8a-47a3-9795-58bb5dfafe4b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:14.051003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1270/2506] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:14.126982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:14.148688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eab55-dacd-4209-92b6-821b67c956f9 service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:14.175635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:14.176956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:14.177694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:14.180598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:14.183600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:14.207465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:14.210519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:14.232900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1237/2507] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:14.794822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:14.795099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:14.795371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:14.829576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:14.830818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:14.845437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:14.911879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1271/2508] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:20:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:14.965155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:14.967116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:15.106171 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f2be-2924-491a-8320-13115fd98a7f service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:15.112574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:15.113227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:15.113983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:15.113983 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:15.125811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:15.127598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106e40b-1721-4d39-b4c3-086ca91cb621 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:15.142512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1238/2509] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:24.902526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=18 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:25.137272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:28.453759 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:28.476032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad74b3c-7a7f-4a04-8c12-36f7c9768327 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:28.481781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:28.482411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:28.482691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:28.482960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:28.484775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:28.511202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:28.513745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:28.527560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1272/2510] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:30.450602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d07ff-220c-4157-a25d-b28d2c927364 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:30.451560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d07ff-220c-4157-a25d-b28d2c927364 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:30.452065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d07ff-220c-4157-a25d-b28d2c927364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:30.486972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-046d07ff-220c-4157-a25d-b28d2c927364 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:30.488284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-046d07ff-220c-4157-a25d-b28d2c927364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:30.495919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1239/2511] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:20:30.508647 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:30.519950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e6a8-7d94-4419-8237-8a7c6306ff74 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:30.525227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:30.525775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:30.526051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:30.526364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:30.534798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:30.536381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141602b-c9d3-4bf1-b66f-73e3f4fa4da0 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:30.545132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1273/2512] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 20:20:30.961845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:30.962210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:30.962478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:30.963927 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1240/2513] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:30.970365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab405e-f377-4f3a-8698-faf0259485f4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:30.977290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab405e-f377-4f3a-8698-faf0259485f4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:30.977577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab405e-f377-4f3a-8698-faf0259485f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.034189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6dab405e-f377-4f3a-8698-faf0259485f4 None None] MFA Rules not processed for user `b25325b450fe4a14941600dd16c557fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:31.035674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6dab405e-f377-4f3a-8698-faf0259485f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:31.059524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1274/2514] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:20:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:31.075471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:31.077326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:31.096269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0073b0-2f68-4f24-bdbf-8c641d03f552 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:31.102497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:31.103109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.103381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.103644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.111361 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:31.112815 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a209b6-a199-46ef-92c9-552b169ab332 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:31.127140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1241/2515] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:31.214219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe18-925a-4fb4-9a0c-ae50c3fbe0ad None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.214494 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe18-925a-4fb4-9a0c-ae50c3fbe0ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.214776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafe18-925a-4fb4-9a0c-ae50c3fbe0ad None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.216189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1275/2516] 10.222.0.61 () {54 vars in 921 bytes} [Mon Aug 29 20:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 20:20:31.222516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.222789 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.223230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.244549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] MFA Rules not processed for user `c5df08926dfe44f3ac00d11414e3513e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:31.245802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:31.255937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1242/2517] 10.222.0.61 () {58 vars in 1018 bytes} [Mon Aug 29 20:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:31.268506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafe18-925a-4fb4-9a0c-ae50c3fbe0ad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:31.280708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafe18-925a-4fb4-9a0c-ae50c3fbe0ad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:31.285488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:31.286014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:31.286296 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:31.286577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:31.297371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:31.298793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af5d01-9c9b-42e1-a8ea-d8abf6ba8011 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:31.310164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1276/2518] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:35.318778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:35.331901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403257-c55a-452b-8a60-bcb911fce929 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:35.338174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:35.338856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:35.339142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:35.339415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:35.341442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:35.356448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:35.358173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:35.374348 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1243/2519] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:39.723302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:39.724471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:39.725957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:39.807732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:39.810061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:39.838867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1277/2520] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:20:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:39.863087 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:39.912712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b79b-248f-4be6-8c63-4ec919096b40 service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:39.931632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:39.932451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:39.932950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:39.933401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:39.974499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:39.976741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:40.011075 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1244/2521] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:41.116989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:41.119544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:41.288184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8d70f-dc64-4aff-baa0-91b7ce59307e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:41.294845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:41.295674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:41.295849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:41.296507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] PATH_INFO: `/v3/users/db988f456a2c48c2a2acd1b2b12d5aed` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:41.298511 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db988f456a2c48c2a2acd1b2b12d5aed)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:41.303170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:41.407576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db988f456a2c48c2a2acd1b2b12d5aed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:41.408284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db988f456a2c48c2a2acd1b2b12d5aed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:41.439618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db988f456a2c48c2a2acd1b2b12d5aed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:41.465515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db988f456a2c48c2a2acd1b2b12d5aed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:41.466539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db988f456a2c48c2a2acd1b2b12d5aed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:41.500254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1278/2522] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:41 2022] DELETE /identity/v3/users/db988f456a2c48c2a2acd1b2b12d5aed => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:41.931324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:41.950577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948bbc6-21c3-4d2f-bbc3-5cc4fc38672f service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:42.077909 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:42.080405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:42.080695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:42.085822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] PATH_INFO: `/v3/projects/046c7a36e34b45f09c8cc876e2fd9967` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:42.088241 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046c7a36e34b45f09c8cc876e2fd9967)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:42.090638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:42.214584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046c7a36e34b45f09c8cc876e2fd9967', 'request_id': 'req-b8a3a0e9-51c9-4638-8576-2434c9a73a39'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.227143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046c7a36e34b45f09c8cc876e2fd9967', 'request_id': 'req-b8a3a0e9-51c9-4638-8576-2434c9a73a39'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.250370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046c7a36e34b45f09c8cc876e2fd9967', 'request_id': 'req-b8a3a0e9-51c9-4638-8576-2434c9a73a39'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.280281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] The token cache is being invalidate because project 046c7a36e34b45f09c8cc876e2fd9967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:42.281354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.282912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.307305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1245/2523] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:41 2022] DELETE /identity/v3/projects/046c7a36e34b45f09c8cc876e2fd9967 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:42.308284 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:42.309968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:42.359482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494c365-295e-478b-a42e-f6a74f5c93d4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:42.384833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:42.527233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:42.528244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:42.528585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:42.528987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] PATH_INFO: `/v3/users/c1971a5dc3d64b189898c2eaa227db9c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:42.530974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1971a5dc3d64b189898c2eaa227db9c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:42.533010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:42.611598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1971a5dc3d64b189898c2eaa227db9c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.613381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1971a5dc3d64b189898c2eaa227db9c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.629429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1971a5dc3d64b189898c2eaa227db9c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.640960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1971a5dc3d64b189898c2eaa227db9c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.642312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1971a5dc3d64b189898c2eaa227db9c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:42.677687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1279/2524] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:42 2022] DELETE /identity/v3/users/c1971a5dc3d64b189898c2eaa227db9c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:20:42.929684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:42.931447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:42.952440 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a0e9-51c9-4638-8576-2434c9a73a39 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:43.028438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:43.117696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:43.118702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:43.119145 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:43.119594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] PATH_INFO: `/v3/projects/ff1ce2b3cf904757a783a154a126dd46` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:43.125204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1ce2b3cf904757a783a154a126dd46)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:43.127836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:43.187387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1ce2b3cf904757a783a154a126dd46', 'request_id': 'req-bac7c674-d612-4177-99a2-31d5936b5541'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:43.196034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1ce2b3cf904757a783a154a126dd46', 'request_id': 'req-bac7c674-d612-4177-99a2-31d5936b5541'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:43.203605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1ce2b3cf904757a783a154a126dd46', 'request_id': 'req-bac7c674-d612-4177-99a2-31d5936b5541'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:43.219094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] The token cache is being invalidate because project ff1ce2b3cf904757a783a154a126dd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:43.219721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:43.220525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:43.222322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1246/2525] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:42 2022] DELETE /identity/v3/projects/ff1ce2b3cf904757a783a154a126dd46 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:45.018150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:45.020057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:45.097235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a1d7d-a430-494d-a50f-1573c170336c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:45.156109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:45.175106 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:45.176013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:45.176603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:45.177860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:45.179880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:45.247816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:45.249290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:45.259009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1280/2526] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:49.867029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:49.868494 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:49.939496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:49.941662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:49.953888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd0e0d-539e-4f34-b477-d2828585793e service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:49.955196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7c674-d612-4177-99a2-31d5936b5541 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:49.959383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:49.960028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:49.960280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:49.960566 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] PATH_INFO: `/v3/users/2f6fbce6c07145b1815510bf9b8f2049` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:49.961751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6fbce6c07145b1815510bf9b8f2049)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:49.962428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:49.963061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:49.963324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:49.965009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:49.967770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:49.967896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:49.979737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:49.981381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:49.992530 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1247/2527] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:50.015867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6fbce6c07145b1815510bf9b8f2049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.016508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6fbce6c07145b1815510bf9b8f2049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.023963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6fbce6c07145b1815510bf9b8f2049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.033501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6fbce6c07145b1815510bf9b8f2049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.034183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b4f605fe-df8c-4dc5-81b3-e6be8eba7fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6fbce6c07145b1815510bf9b8f2049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.054082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1281/2528] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:49 2022] DELETE /identity/v3/users/2f6fbce6c07145b1815510bf9b8f2049 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:50.315384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.327734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57c64a-9c4b-4a63-9d8f-c4c1a23225e7 service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.389186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:50.403864 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.404500 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.404846 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.405116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] PATH_INFO: `/v3/projects/7b3b1b1e93f242dd9824c206ee3efc57` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.406242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3b1b1e93f242dd9824c206ee3efc57)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.408141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.462472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3b1b1e93f242dd9824c206ee3efc57', 'request_id': 'req-ee5c892f-12c0-4081-8171-089b8e0ccf70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.469016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3b1b1e93f242dd9824c206ee3efc57', 'request_id': 'req-ee5c892f-12c0-4081-8171-089b8e0ccf70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.475349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3b1b1e93f242dd9824c206ee3efc57', 'request_id': 'req-ee5c892f-12c0-4081-8171-089b8e0ccf70'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.489794 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] The token cache is being invalidate because project 7b3b1b1e93f242dd9824c206ee3efc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:50.490082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.490732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ee5c892f-12c0-4081-8171-089b8e0ccf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:50.492230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1248/2529] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:50 2022] DELETE /identity/v3/projects/7b3b1b1e93f242dd9824c206ee3efc57 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:50.497144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.497422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.497688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.550542 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:50.552027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:50.592670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:50.617829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1282/2530] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:50.626741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.627198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.627529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.656093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:50.657365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:50.666943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1249/2531] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:50.671357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.685526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c13f6-b97a-4814-a1b9-d51614de7bec None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.690858 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.691465 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.691731 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.691998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.692694 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:20:50.693041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.694645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.707313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1283/2532] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:50.712007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.721798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6f561-6a35-478c-9834-653106ee1d93 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.727616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.728202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.728496 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.728768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.729420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.731304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.772731 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1250/2533] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:50 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:50.776767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.787740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad6ed9-8561-4739-9342-c5259cf13a27 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.847524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.848155 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.848416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.849257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.850003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.851948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.876017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1284/2534] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:50 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:50.880942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.892391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fde7d-c942-4a6f-8903-3c26b58e9915 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.899640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.900406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.900765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.901263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.902306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.903993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.920493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1251/2535] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:50.925442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.936281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033a42f-6ec1-4613-bb1d-b66d57cc7bc8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.943628 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.944601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.945105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.945530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:50.946558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:50.949143 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f216885-ae10-4272-ae16-ec0daa96e901 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:50.967110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1285/2536] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:50.972255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:50.983460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579829f-e1f0-44d0-b2b6-2b883a913e01 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:50.991026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:50.991741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:50.992014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:50.992281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] PATH_INFO: `/v3/projects/6974b194ebc847e49f056db4cbab1ce4/users/0528a7b5cb494b2ba0409d07d117b1b7/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.015478 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6974b194ebc847e49f056db4cbab1ce4, user_id=0528a7b5cb494b2ba0409d07d117b1b7, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.018447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.036913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1252/2537] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:50 2022] PUT /identity/v3/projects/6974b194ebc847e49f056db4cbab1ce4/users/0528a7b5cb494b2ba0409d07d117b1b7/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:51.047848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.048141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.048401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.080042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] MFA Rules not processed for user `0528a7b5cb494b2ba0409d07d117b1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:51.081277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:51.154270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1286/2538] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:51.158970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.225221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767b421-22ef-461f-b7ad-c762df49ef80 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.230164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.230774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.231051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.231326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.231952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.233919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.245694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:51.263477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1253/2539] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:51 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:51.267788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.279306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49aff8-0879-4267-83f5-a3be9f22a4ce None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.316539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:51.352605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.353255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.353553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.353808 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.354438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.356400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.380503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1287/2540] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:51 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:51.384858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.399481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436e7d1-c3a1-4953-ac5c-e36c3f64b789 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.404381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.405018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.405286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.406018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.406195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.407771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.418278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1254/2541] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:20:51.422704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.434074 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64097d-a331-4fc3-a9df-f0096d75dace admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.439243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.439906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.440190 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.440467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] PATH_INFO: `/v3/projects/859dd9aa63af48a9943121e0ba901e24/users/09c88864a585473f96fe0079166468d8/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.457642 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859dd9aa63af48a9943121e0ba901e24, user_id=09c88864a585473f96fe0079166468d8, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.460517 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.475621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1288/2542] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:51 2022] PUT /identity/v3/projects/859dd9aa63af48a9943121e0ba901e24/users/09c88864a585473f96fe0079166468d8/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:51.479747 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.491149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd503f6-09eb-401c-90f1-e2347d2dbd50 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.553106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.553722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.554000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.554271 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.554925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.556542 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5b8f-776c-4679-80b1-275ad907b581 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.566933 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1255/2543] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:51.571493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.587059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8ef0d-f552-4222-bce8-8668dadb64d8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.592287 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.593012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.593315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.593586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] PATH_INFO: `/v3/projects/859dd9aa63af48a9943121e0ba901e24/users/09c88864a585473f96fe0079166468d8/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.595561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=859dd9aa63af48a9943121e0ba901e24, user_id=09c88864a585473f96fe0079166468d8, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.598266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.610229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1289/2544] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:51 2022] PUT /identity/v3/projects/859dd9aa63af48a9943121e0ba901e24/users/09c88864a585473f96fe0079166468d8/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:51.622817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.623095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.623359 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.659339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] MFA Rules not processed for user `09c88864a585473f96fe0079166468d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:51.660553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:51.741959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1256/2545] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:51.753674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:51.755942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:51.845603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ec0d-a399-49f5-aea3-c5d685f76dee admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:51.850490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:51.851101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:51.851346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:51.851645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:51.866080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:51.868223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d178f-040c-420b-bf12-89fd7f27baeb service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:51.881968 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1290/2546] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:52.330783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:52.397266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1a05-d7b1-44d9-ab1e-3037ddb60c0d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:52.402277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:52.402911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:52.403170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:52.403441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] PATH_INFO: `/v3/users/0528a7b5cb494b2ba0409d07d117b1b7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:52.404591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0528a7b5cb494b2ba0409d07d117b1b7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:52.406565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:52.408973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:52.475730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0528a7b5cb494b2ba0409d07d117b1b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:52.484332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0528a7b5cb494b2ba0409d07d117b1b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:52.499597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0528a7b5cb494b2ba0409d07d117b1b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:52.500433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0528a7b5cb494b2ba0409d07d117b1b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:52.501085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0528a7b5cb494b2ba0409d07d117b1b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:52.518638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1257/2547] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:52 2022] DELETE /identity/v3/users/0528a7b5cb494b2ba0409d07d117b1b7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:52.523624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:52.524138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:52.524253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:52.544874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:52.546164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:52.627925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1291/2548] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:52.638497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:52.640015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:52.712168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a693-81d0-4355-9d06-d6672ea085f8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:52.719220 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:52.720117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:52.720487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:52.720881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:52.734464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:52.736061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:52.748946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1258/2549] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:53.042856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:53.044478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:53.058271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a1e4-4f31-4ce9-97ce-e8a204207c39 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:53.063965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:53.064620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:53.064939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:53.065209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] PATH_INFO: `/v3/projects/6974b194ebc847e49f056db4cbab1ce4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:53.066441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6974b194ebc847e49f056db4cbab1ce4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:53.068543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:53.077428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:53.129599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6974b194ebc847e49f056db4cbab1ce4', 'request_id': 'req-109fc161-adf4-4611-b2a2-39b7f8126102'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.139755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6974b194ebc847e49f056db4cbab1ce4', 'request_id': 'req-109fc161-adf4-4611-b2a2-39b7f8126102'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.147987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6974b194ebc847e49f056db4cbab1ce4', 'request_id': 'req-109fc161-adf4-4611-b2a2-39b7f8126102'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.170617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] The token cache is being invalidate because project 6974b194ebc847e49f056db4cbab1ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:53.171184 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.172212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.175354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1292/2550] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:53 2022] DELETE /identity/v3/projects/6974b194ebc847e49f056db4cbab1ce4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:53.180115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:53.193823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d057ba1-2c1e-4e32-aa35-f451a9bf5968 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:53.273838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:53.274826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:53.275168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:53.275501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] PATH_INFO: `/v3/users/09c88864a585473f96fe0079166468d8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:53.276771 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c88864a585473f96fe0079166468d8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:53.278788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:53.312111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:53.337255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c88864a585473f96fe0079166468d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.345235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c88864a585473f96fe0079166468d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.358946 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c88864a585473f96fe0079166468d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.359672 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c88864a585473f96fe0079166468d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.360275 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5af80a98-d4a5-45a5-9087-50187202ac61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c88864a585473f96fe0079166468d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.376404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1259/2551] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:53 2022] DELETE /identity/v3/users/09c88864a585473f96fe0079166468d8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:53.684148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:53.685877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:53.705626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc161-adf4-4611-b2a2-39b7f8126102 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:53.766432 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:53.767083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:53.767356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:53.767622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] PATH_INFO: `/v3/projects/859dd9aa63af48a9943121e0ba901e24` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:53.768962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859dd9aa63af48a9943121e0ba901e24)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:53.771406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:53.838221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859dd9aa63af48a9943121e0ba901e24', 'request_id': 'req-d41eb78d-cf57-4379-81a0-391a74525f85'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.849639 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859dd9aa63af48a9943121e0ba901e24', 'request_id': 'req-d41eb78d-cf57-4379-81a0-391a74525f85'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.856312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859dd9aa63af48a9943121e0ba901e24', 'request_id': 'req-d41eb78d-cf57-4379-81a0-391a74525f85'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.872213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] The token cache is being invalidate because project 859dd9aa63af48a9943121e0ba901e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:53.872505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.873139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d41eb78d-cf57-4379-81a0-391a74525f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:53.874679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1293/2552] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:53 2022] DELETE /identity/v3/projects/859dd9aa63af48a9943121e0ba901e24 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:53.881059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:53.881430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:53.881786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:53.903268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:53.904471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:53.977232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1260/2553] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:53.985556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:53.985919 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:53.986042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.007921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:54.009171 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:54.022177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1294/2554] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:20:54.033925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.045242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d20433-1cc0-4a55-a663-1f77d36c73ea None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.052330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.053011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.053283 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.053528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.054197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:20:54.054476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.056095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.069635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1261/2555] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:54.074535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.084653 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474989e6-82c4-4b4e-87af-b9d8f8ab5f45 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.091754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.092382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.092657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.092949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.093589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.095488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.121257 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:54.137545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1295/2556] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:54 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:54.137787 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.149230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c95c76-d0de-43c2-ba08-5f05011c1b0b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.222047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.222661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.222931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.223200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.224165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.226306 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.249501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1262/2557] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:54 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:54.254041 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.269775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199f817-3918-4a2b-a3d1-636ab5d5adc9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.277026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.277645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.277913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.278178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.278825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.280409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.291431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1296/2558] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:54.296599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.307883 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a1e28-a922-4c28-8adc-ce3b357a4c93 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.315153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.315764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.316040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.316305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.316982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.318754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132745b-0e81-41aa-b6ec-0935303852f7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.331472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1263/2559] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:54.336932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.347792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794d3b1-6704-454e-add8-02ff3d9e6522 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.354237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.354895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.355164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.355426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] PATH_INFO: `/v3/projects/548f01b0003347ceb23708e876a3da0c/users/e3d59ebe19f647f1bf5b5ffec93e17e0/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.373551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=548f01b0003347ceb23708e876a3da0c, user_id=e3d59ebe19f647f1bf5b5ffec93e17e0, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.378732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.398417 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1297/2560] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:54 2022] PUT /identity/v3/projects/548f01b0003347ceb23708e876a3da0c/users/e3d59ebe19f647f1bf5b5ffec93e17e0/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:54.412146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.412922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.412922 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.435934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:54.446996 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] MFA Rules not processed for user `e3d59ebe19f647f1bf5b5ffec93e17e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:54.448302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:54.565876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1264/2561] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:54.570483 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.653320 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cbed-dffb-4ef1-b691-b0c7a369e74d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.664332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.664999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.665272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.665536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.666199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.668107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.698440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1298/2562] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:54 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:54.702842 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.714240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43c00-8b53-4770-af8f-767af64019ec None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.778327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.779305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.779579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.780129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.780805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.783047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.813310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1265/2563] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:54 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:54.814991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.827071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064b6eb-da7b-47fb-aa9d-ed2e39d0d5d2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.833011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.834382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.834883 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.835223 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.835956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.837672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.851130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1299/2564] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:54.855475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.866972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d2c5-43bf-40a4-b400-03fb4b9c3203 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:54.872205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:54.872941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:54.873222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:54.873525 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] PATH_INFO: `/v3/projects/fd39af0add0b4ae7a20f550d44d86063/users/3965c38d370f4f4e92b75d287ab58657/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:54.894755 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd39af0add0b4ae7a20f550d44d86063, user_id=3965c38d370f4f4e92b75d287ab58657, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:54.898466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:54.913999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1266/2565] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:54 2022] PUT /identity/v3/projects/fd39af0add0b4ae7a20f550d44d86063/users/3965c38d370f4f4e92b75d287ab58657/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:54.918023 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:54.929775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b45ae-232b-4280-a378-f0a0aea23c2f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:55.000239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:55.000897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.001231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.001520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.002232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:55.003880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86181d3-a4ca-4563-90d9-298b7c843269 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:55.017315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1300/2566] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:55.022376 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:55.033686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131553-8f53-4795-ab13-97d9d3869ce3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:55.039721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:55.040408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.040683 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.041046 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] PATH_INFO: `/v3/projects/fd39af0add0b4ae7a20f550d44d86063/users/3965c38d370f4f4e92b75d287ab58657/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.043040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd39af0add0b4ae7a20f550d44d86063, user_id=3965c38d370f4f4e92b75d287ab58657, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:55.045849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:55.059185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1267/2567] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:55 2022] PUT /identity/v3/projects/fd39af0add0b4ae7a20f550d44d86063/users/3965c38d370f4f4e92b75d287ab58657/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:55.071163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.071415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.071674 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.103890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] MFA Rules not processed for user `3965c38d370f4f4e92b75d287ab58657`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:55.105125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:55.127613 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:55.180886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1301/2568] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:55.193137 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:55.196324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:55.273424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df6e98-fef8-42bc-8a11-dd671c2e2853 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:55.277446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:55.278079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.278392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.278661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.285392 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:55.291093 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:55.292736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cb6fd-c53e-4f88-af43-e45698fc9e85 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:55.303347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1268/2569] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:55.798528 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:55.870966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf9b40-fe5e-4bb1-93a4-027de20f4977 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:55.876507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:55.877191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.877466 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.877736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] PATH_INFO: `/v3/users/e3d59ebe19f647f1bf5b5ffec93e17e0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:55.878955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d59ebe19f647f1bf5b5ffec93e17e0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:55.881033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:55.943346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d59ebe19f647f1bf5b5ffec93e17e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:55.943969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d59ebe19f647f1bf5b5ffec93e17e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:55.951605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d59ebe19f647f1bf5b5ffec93e17e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:55.960660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d59ebe19f647f1bf5b5ffec93e17e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:55.961369 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d59ebe19f647f1bf5b5ffec93e17e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:55.983942 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1302/2570] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:55 2022] DELETE /identity/v3/users/e3d59ebe19f647f1bf5b5ffec93e17e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:55.988585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8369-40b0-4772-ba46-bfb0f1ddc050 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:55.989239 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8369-40b0-4772-ba46-bfb0f1ddc050 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:55.989421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8369-40b0-4772-ba46-bfb0f1ddc050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.011044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-03ae8369-40b0-4772-ba46-bfb0f1ddc050 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:56.012480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-03ae8369-40b0-4772-ba46-bfb0f1ddc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:56.081044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1269/2571] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:56.093790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.095782 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:56.142081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:56.160077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196988-0faa-4722-9df0-7516adcf8ee4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.164119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.164778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.165086 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.165354 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.176799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.178691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.188826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1303/2572] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:56.302533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.302877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.303170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.335796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:56.337179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:56.408073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1270/2573] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:20:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:20:56.421458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.423014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:56.500112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.501765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:56.503495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779f11-aadb-4d8e-86f6-b3302b4cd0ec service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.510803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.511435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.511714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.512421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.518719 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704176cd-f472-44df-9cc8-0248765f9f90 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.525078 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.525279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.526009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.526397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.526763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] PATH_INFO: `/v3/projects/548f01b0003347ceb23708e876a3da0c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.528114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.528351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=548f01b0003347ceb23708e876a3da0c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.530499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.540109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1304/2574] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:20:56.591387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548f01b0003347ceb23708e876a3da0c', 'request_id': 'req-9133f994-e693-45ea-84d1-527f78e02c9c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.604195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548f01b0003347ceb23708e876a3da0c', 'request_id': 'req-9133f994-e693-45ea-84d1-527f78e02c9c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.611164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548f01b0003347ceb23708e876a3da0c', 'request_id': 'req-9133f994-e693-45ea-84d1-527f78e02c9c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.627780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] The token cache is being invalidate because project 548f01b0003347ceb23708e876a3da0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:56.628009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.628934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.630365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1271/2575] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:56 2022] DELETE /identity/v3/projects/548f01b0003347ceb23708e876a3da0c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:56.634546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:56.646744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a71-81f1-4586-b9a3-48a2913d5125 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:56.721976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:56.722781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:56.723199 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:56.723550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] PATH_INFO: `/v3/users/3965c38d370f4f4e92b75d287ab58657` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:56.725849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3965c38d370f4f4e92b75d287ab58657)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:56.728344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:56.787992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3965c38d370f4f4e92b75d287ab58657'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.788587 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3965c38d370f4f4e92b75d287ab58657'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.796739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3965c38d370f4f4e92b75d287ab58657'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.806081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3965c38d370f4f4e92b75d287ab58657'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.807892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-20457ccc-8984-479c-adb3-5c40d01ad1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3965c38d370f4f4e92b75d287ab58657'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:56.818864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:56.836939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1305/2576] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:20:56 2022] DELETE /identity/v3/users/3965c38d370f4f4e92b75d287ab58657 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:57.146243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.149847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:57.170269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133f994-e693-45ea-84d1-527f78e02c9c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.196282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:57.243472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.244150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.244420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.244684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] PATH_INFO: `/v3/projects/fd39af0add0b4ae7a20f550d44d86063` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.246080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd39af0add0b4ae7a20f550d44d86063)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.248015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.329210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd39af0add0b4ae7a20f550d44d86063', 'request_id': 'req-ea578490-2363-46dc-9ed5-773345b01d6f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:57.336871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd39af0add0b4ae7a20f550d44d86063', 'request_id': 'req-ea578490-2363-46dc-9ed5-773345b01d6f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:57.343041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd39af0add0b4ae7a20f550d44d86063', 'request_id': 'req-ea578490-2363-46dc-9ed5-773345b01d6f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:57.358449 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] The token cache is being invalidate because project fd39af0add0b4ae7a20f550d44d86063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:20:57.358735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:57.359396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ea578490-2363-46dc-9ed5-773345b01d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:20:57.361108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1272/2577] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:20:57 2022] DELETE /identity/v3/projects/fd39af0add0b4ae7a20f550d44d86063 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:57.367717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.368056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.368351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.399418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:57.400648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:57.465081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1306/2578] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:57.474448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.474850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.475324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.499739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:57.501037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:57.510511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1273/2579] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:57.515057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.527703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa869c-4993-41e2-a193-d91f090dd79d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.533791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.534643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.534948 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.535235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.536179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:20:57.536707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.538903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.560693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1307/2580] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:20:57.565653 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.575504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660399ba-0e8b-4439-a2b1-812c8c853482 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.581476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.581891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.582285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.582557 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.583430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.585566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.627589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.632862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1274/2581] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:57 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:57.638658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27747-2ea0-485d-969f-46791564ab4d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.710669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.712013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.712013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.712013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.712540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.714385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.744945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1308/2582] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:57 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:20:57.748505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.760301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e0f19-49ea-4420-88b4-cfed2672e164 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.765526 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.766144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.766428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.766692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.767355 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.769001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.783818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1275/2583] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:20:57.785521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.800114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeea0c-70bb-4ea7-bb53-a38574d95e41 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.806967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.807617 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.808092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.808560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.809333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.810946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3293c-75de-4f99-ad78-44c048ddf1a3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.823062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1309/2584] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:57.828285 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:57.840292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb816c-378c-4560-a58a-6d54b54d5110 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:57.850070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:57.850743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.851015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.851301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] PATH_INFO: `/v3/projects/4ced21f6e8e9486bac005e779a22f72a/users/28a13696e19346b990f366b77c124bd5/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.867799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ced21f6e8e9486bac005e779a22f72a, user_id=28a13696e19346b990f366b77c124bd5, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:57.870507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:57.887686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1276/2585] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:57 2022] PUT /identity/v3/projects/4ced21f6e8e9486bac005e779a22f72a/users/28a13696e19346b990f366b77c124bd5/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:20:57.893059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dca5b-1379-45f0-9b50-43036ae14033 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:57.893338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dca5b-1379-45f0-9b50-43036ae14033 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:57.893611 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dca5b-1379-45f0-9b50-43036ae14033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:57.916170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f04dca5b-1379-45f0-9b50-43036ae14033 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:57.917444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f04dca5b-1379-45f0-9b50-43036ae14033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:57.983393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:57.994871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1310/2586] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:58.006773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:58.009256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:58.074876 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:20:58.088992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22a38c-adb8-4de5-96e8-5d11daa293b6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:58.094208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:58.094820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:58.095095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:58.095396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:58.112126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:58.112126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:58.122857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1277/2587] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:20:59.096683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.097243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.097243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.127439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] MFA Rules not processed for user `28a13696e19346b990f366b77c124bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:20:59.128677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:20:59.201357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1311/2588] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:20:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:20:59.206155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.216892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990948f7-8497-492b-aba9-1100d2003f0f service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.225142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.225849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.226172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.226464 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.227109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.229133 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.264972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1278/2589] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:20:59 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:20:59.267685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.286560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b21ad-47a1-4f35-8f64-0c7d132e28e3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.354930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.355548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.355826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.356088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.356733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.358762 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.382010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1312/2590] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:20:59 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:20:59.386157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.398442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1c60d-7716-4f3d-b2b9-81c4a1cd83d1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.403819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.404408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.404706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.404990 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.405633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.407244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.418826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1279/2591] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:20:59.423379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.434122 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b2e9-49b6-4e63-8641-0af03edecef3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.439162 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.439845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.440121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.440390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] PATH_INFO: `/v3/projects/992d60c3e687476b8f3677650b85adb4/users/a25c92d52c61473eb0548c12b9a4bf74/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.459928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=992d60c3e687476b8f3677650b85adb4, user_id=a25c92d52c61473eb0548c12b9a4bf74, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.462749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.484586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1313/2592] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:59 2022] PUT /identity/v3/projects/992d60c3e687476b8f3677650b85adb4/users/a25c92d52c61473eb0548c12b9a4bf74/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:20:59.489193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.500393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35684ab-ca5a-4d2e-9be5-cc0a3bb3aadd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.571659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.572281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.572607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.573004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.573911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.576191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee4405-541b-4d1a-9466-075c096609a7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.588581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1280/2593] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:20:59.592888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:20:59.603780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566022b6-da52-4a41-ace7-f2f4210efcee admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:20:59.608669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:20:59.609357 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:20:59.609633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:20:59.609903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] PATH_INFO: `/v3/projects/992d60c3e687476b8f3677650b85adb4/users/a25c92d52c61473eb0548c12b9a4bf74/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:20:59.611957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=992d60c3e687476b8f3677650b85adb4, user_id=a25c92d52c61473eb0548c12b9a4bf74, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:20:59.614760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af2d7c-026d-4427-9fb3-3cac8046f00e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:20:59.626111 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1314/2594] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:20:59 2022] PUT /identity/v3/projects/992d60c3e687476b8f3677650b85adb4/users/a25c92d52c61473eb0548c12b9a4bf74/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:00.350096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.350693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.350693 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.386178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] MFA Rules not processed for user `a25c92d52c61473eb0548c12b9a4bf74`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:00.387335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:00.460138 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1281/2595] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:00.470397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.470964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.470964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.493251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] MFA Rules not processed for user `28a13696e19346b990f366b77c124bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:00.494497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:00.529798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:00.557085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1315/2596] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:00.568874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:00.570369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:00.616407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:00.652957 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2589-426c-47e7-a503-35dd9efd621d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:00.659501 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:00.660109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:00.660386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:00.660654 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:00.670126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:00.671726 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab137340-1413-40ea-b35c-de6e700a0ae3 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:00.681347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1282/2597] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:00.944832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:00.946315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:01.014902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63911a8-6610-42bd-882e-110926bf46c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:01.018945 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:01.019557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:01.019833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:01.020503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:01.022160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:01.032069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:01.033506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:01.041965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1316/2598] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:10.488462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:10.489708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:10.489708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:10.508806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] MFA Rules not processed for user `5baeae00a21f4b26b7ede28c998b31bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:10.510054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:10.567104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1283/2599] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:11.039117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=34 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:14.197022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:14.198129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:14.270091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33599cfd-6b27-4e08-b655-19765a87b116 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:14.274343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:14.275485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:14.275909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:14.276438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:14.286940 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:14.288384 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:14.304953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1317/2600] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:20.560117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=41 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:24.295263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=26 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:36.099097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:36.185847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009875d-f9ad-4349-a6f3-7030a583db88 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:36.191725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:36.192476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:36.192823 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:36.193104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] PATH_INFO: `/v3/users/28a13696e19346b990f366b77c124bd5` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:36.194310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a13696e19346b990f366b77c124bd5)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:36.196286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:36.252509 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a13696e19346b990f366b77c124bd5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.260701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a13696e19346b990f366b77c124bd5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.274269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a13696e19346b990f366b77c124bd5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.275011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a13696e19346b990f366b77c124bd5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.275615 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a13696e19346b990f366b77c124bd5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.291932 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1284/2601] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:36 2022] DELETE /identity/v3/users/28a13696e19346b990f366b77c124bd5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:21:36.506272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:36.524480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56f5b9-54c4-4399-b2e6-af4347d58530 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:36.594764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:36.595435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:36.595693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:36.595965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] PATH_INFO: `/v3/projects/4ced21f6e8e9486bac005e779a22f72a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:36.598071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ced21f6e8e9486bac005e779a22f72a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:36.599725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:36.656564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ced21f6e8e9486bac005e779a22f72a', 'request_id': 'req-e0b3a273-d568-4a07-97dc-7052608b08ca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.665983 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ced21f6e8e9486bac005e779a22f72a', 'request_id': 'req-e0b3a273-d568-4a07-97dc-7052608b08ca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.674673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ced21f6e8e9486bac005e779a22f72a', 'request_id': 'req-e0b3a273-d568-4a07-97dc-7052608b08ca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.706622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] The token cache is being invalidate because project 4ced21f6e8e9486bac005e779a22f72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:36.707556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.708828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.711157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1318/2602] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:36 2022] DELETE /identity/v3/projects/4ced21f6e8e9486bac005e779a22f72a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:21:36.715903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:36.717593 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:36.732859 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb013-115e-47a0-8cfc-63637542b83c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:36.803881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:36.804400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:36.804646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:36.805025 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] PATH_INFO: `/v3/users/a25c92d52c61473eb0548c12b9a4bf74` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:36.806569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25c92d52c61473eb0548c12b9a4bf74)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:36.808711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:36.837788 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:36.884105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25c92d52c61473eb0548c12b9a4bf74'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.895553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25c92d52c61473eb0548c12b9a4bf74'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.910778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25c92d52c61473eb0548c12b9a4bf74'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.911766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25c92d52c61473eb0548c12b9a4bf74'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.912492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-14d8459a-b166-40d0-9594-9cc67b65d317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25c92d52c61473eb0548c12b9a4bf74'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:36.928892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1285/2603] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:36 2022] DELETE /identity/v3/users/a25c92d52c61473eb0548c12b9a4bf74 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:37.168340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.170224 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:37.188310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3a273-d568-4a07-97dc-7052608b08ca admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.250689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.251312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.251583 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.251844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] PATH_INFO: `/v3/projects/992d60c3e687476b8f3677650b85adb4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.253027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992d60c3e687476b8f3677650b85adb4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.255072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.293708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:37.310453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992d60c3e687476b8f3677650b85adb4', 'request_id': 'req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:37.318992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992d60c3e687476b8f3677650b85adb4', 'request_id': 'req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:37.326765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992d60c3e687476b8f3677650b85adb4', 'request_id': 'req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:37.343420 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] The token cache is being invalidate because project 992d60c3e687476b8f3677650b85adb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:37.344000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:37.344339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6cd50ed-844a-4a5a-a057-8ae11715e3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:37.345885 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1319/2604] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:37 2022] DELETE /identity/v3/projects/992d60c3e687476b8f3677650b85adb4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:37.351389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.351906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.352023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.375105 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:37.376333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:37.443484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1286/2605] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:37.452026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.452275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.452522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.475838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:37.477112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:37.487422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1320/2606] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:37.492252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.502704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d39e96-a3dc-4ea9-b033-d6569d644feb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.508514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.509158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.509439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.509710 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.510368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:37.510671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.512310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.529761 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1287/2607] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:37.534447 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.544984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb0b82-a75c-427c-8a98-868a71096fe4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.551666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.552395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.552785 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.553063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.553773 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.555736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.592264 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1321/2608] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:37 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:37.596638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.608374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84959-b48d-4f6b-816b-e5641ad6d27a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.676288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.676947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.677212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.677490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.678123 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.680052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.702766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1288/2609] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:37 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:37.708596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.721705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bb57-465d-4c06-b4ba-d9ebe534cc46 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.727804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.728488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.728840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.729144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.729853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.731527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.744303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1322/2610] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:21:37.753515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.764598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efcba-fade-4f1b-bb7f-81e8fa83d719 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.770374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.770978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.771251 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.771515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.772166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.773820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2845f65-062d-4459-a1ea-95f113dc39f0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.787573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1289/2611] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:37.792031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.803807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a98f-94c7-4fc4-ba00-840f1fc9a3b2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:37.809154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:37.809780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.810431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.810431 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] PATH_INFO: `/v3/projects/3c1d2ed9b50d478d9f8563677eb7e8a1/users/c2b00f457f2e411ea3084f2686f2052e/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.827017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1d2ed9b50d478d9f8563677eb7e8a1, user_id=c2b00f457f2e411ea3084f2686f2052e, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:37.829671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:37.844406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1323/2612] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:37 2022] PUT /identity/v3/projects/3c1d2ed9b50d478d9f8563677eb7e8a1/users/c2b00f457f2e411ea3084f2686f2052e/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:37.856880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566383-6e53-4219-9799-51509a6326ff None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:37.857210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566383-6e53-4219-9799-51509a6326ff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:37.857486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566383-6e53-4219-9799-51509a6326ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:37.866216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:37.889236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-31566383-6e53-4219-9799-51509a6326ff None None] MFA Rules not processed for user `c2b00f457f2e411ea3084f2686f2052e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:37.890472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-31566383-6e53-4219-9799-51509a6326ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:37.966507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1290/2613] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:21:37.979343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:37.981567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:38.049100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b242-9b48-42d1-8ad4-eaa392816e21 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:38.052930 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:38.053553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:38.053826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:38.054110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:38.063300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:38.064738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d735b-a214-4854-a31e-89d623750eb6 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:38.074598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1324/2614] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:38.099470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31566383-6e53-4219-9799-51509a6326ff None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:38.176366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31566383-6e53-4219-9799-51509a6326ff None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:38.181164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:38.181810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:38.182079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:38.182947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] PATH_INFO: `/v3/users/c2b00f457f2e411ea3084f2686f2052e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:38.183640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b00f457f2e411ea3084f2686f2052e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:38.185769 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:38.253366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b00f457f2e411ea3084f2686f2052e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.262920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b00f457f2e411ea3084f2686f2052e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.278266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b00f457f2e411ea3084f2686f2052e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.279109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b00f457f2e411ea3084f2686f2052e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.279805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b00f457f2e411ea3084f2686f2052e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.298055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1291/2615] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:38 2022] DELETE /identity/v3/users/c2b00f457f2e411ea3084f2686f2052e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:38.303185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384316-f391-476f-92df-fada0826eb6d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:38.303505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384316-f391-476f-92df-fada0826eb6d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:38.303777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9384316-f391-476f-92df-fada0826eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:38.326014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d9384316-f391-476f-92df-fada0826eb6d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:38.327241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9384316-f391-476f-92df-fada0826eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:38.390598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:38.404435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1325/2616] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:38.411660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:38.413481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:38.431838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:38.495650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490247b-373c-48a9-81e2-d28f17cc4008 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:38.501125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:38.502082 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:38.502459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:38.502813 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:38.513469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:38.514944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea347fa-34b3-4858-8549-0fb805f32272 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:38.527650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1292/2617] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:38.856775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9384316-f391-476f-92df-fada0826eb6d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:38.858603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9384316-f391-476f-92df-fada0826eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:38.879521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9384316-f391-476f-92df-fada0826eb6d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:38.883356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:38.884426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:38.884953 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:38.885159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] PATH_INFO: `/v3/projects/3c1d2ed9b50d478d9f8563677eb7e8a1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:38.886557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1d2ed9b50d478d9f8563677eb7e8a1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:38.888794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:38.952981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1d2ed9b50d478d9f8563677eb7e8a1', 'request_id': 'req-0c023e86-1262-4c07-971e-8623b73df544'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.965698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1d2ed9b50d478d9f8563677eb7e8a1', 'request_id': 'req-0c023e86-1262-4c07-971e-8623b73df544'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:38.980307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1d2ed9b50d478d9f8563677eb7e8a1', 'request_id': 'req-0c023e86-1262-4c07-971e-8623b73df544'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:39.007331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] The token cache is being invalidate because project 3c1d2ed9b50d478d9f8563677eb7e8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:39.007331 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:39.007911 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c023e86-1262-4c07-971e-8623b73df544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:39.009873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1326/2618] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:38 2022] DELETE /identity/v3/projects/3c1d2ed9b50d478d9f8563677eb7e8a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:39.016383 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.016919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.017386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.058366 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:39.059611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:39.153529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1293/2619] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:39.155405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.155865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.156138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.177793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:39.179012 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:39.191266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1327/2620] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:39.195822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.207057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb82ed9-2531-4232-93fc-7f773cbb51c8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.217904 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.218484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.218838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.219003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.219961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:39.220267 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.221949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.242400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1294/2621] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:39.243622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.259523 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b279d83-e3be-43c4-8e54-070a88ec5822 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.264525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.265188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.265451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.265720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.266363 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.268274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.320178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1328/2622] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:39.324661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.337350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662d49d-0fcf-45c7-855f-305bfc69ddf4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.430301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.430910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.431197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.431535 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.432243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.434511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.477002 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1295/2623] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:39.478547 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.505062 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcbc46-ff66-4bda-822b-d9b7c2952127 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.517816 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.518840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.519339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.520066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.521071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.523104 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.541996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1329/2624] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:39.544373 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.570829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb5afb-892b-457b-b65e-c80b00ad9b44 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.586967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.588295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.588818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.589297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.591333 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.596519 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00458761-62a6-4dfa-8517-abce93e29501 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.621893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1296/2625] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:21:39.628009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.644101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5367c-6dcd-448c-923c-d09582d4524a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.671276 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.676774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.676774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.676774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] PATH_INFO: `/v3/projects/ec06331adfbe4b0b89eeddac2dc48715/users/edd522a6c4004c33ad65e066462e12e6/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.704934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec06331adfbe4b0b89eeddac2dc48715, user_id=edd522a6c4004c33ad65e066462e12e6, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.708085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:39.729596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1330/2626] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:39 2022] PUT /identity/v3/projects/ec06331adfbe4b0b89eeddac2dc48715/users/edd522a6c4004c33ad65e066462e12e6/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:21:39.742111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.742591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.743052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.777258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] MFA Rules not processed for user `edd522a6c4004c33ad65e066462e12e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:39.778476 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:39.790510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:39.889195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1297/2627] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:39.902590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:39.904434 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:39.977020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46d7e-c11f-48f6-a733-e971a57f2b9d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:39.981933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b756232a28874eba8520a100216a156a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:39.982569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:39.982846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:39.983117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:39.997743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:39.999288 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:40.012061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1331/2628] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:43.851463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:43.852995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:43.925547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96b6fa-9df0-4966-9760-f6ca32efa6ad None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:43.931125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:43.931732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:43.931995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:43.932245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:43.934208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:44.010965 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:44.012455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:44.024483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1298/2629] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:21:47.974443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:47.981861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:48.018552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842779b1-7e49-4c4a-b9d1-1762ccab6e1f service glance] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.024960 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.025623 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.025893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.026157 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] PATH_INFO: `/v3/users/e3cc61673b284d8dae02a659a6635adc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.027436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cc61673b284d8dae02a659a6635adc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.029471 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.049531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:48.087619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cc61673b284d8dae02a659a6635adc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.088424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cc61673b284d8dae02a659a6635adc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.100734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cc61673b284d8dae02a659a6635adc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.109937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cc61673b284d8dae02a659a6635adc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.110637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08caa36e-3032-499d-bad9-83ad474f08af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cc61673b284d8dae02a659a6635adc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.142552 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1332/2630] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:47 2022] DELETE /identity/v3/users/e3cc61673b284d8dae02a659a6635adc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:48.375665 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:48.396910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25801472-e1da-45bc-92c7-8ae4fde6954c service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.481049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.481973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.482334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.482734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] PATH_INFO: `/v3/projects/de9965393a52440fa24f4577683a567d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.484660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9965393a52440fa24f4577683a567d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.488729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.494444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:48.554098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9965393a52440fa24f4577683a567d', 'request_id': 'req-66907b96-73c9-42c5-becc-fac397bcdf22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.561750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9965393a52440fa24f4577683a567d', 'request_id': 'req-66907b96-73c9-42c5-becc-fac397bcdf22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.571538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9965393a52440fa24f4577683a567d', 'request_id': 'req-66907b96-73c9-42c5-becc-fac397bcdf22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.587101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] The token cache is being invalidate because project de9965393a52440fa24f4577683a567d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:48.587460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.588195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-66907b96-73c9-42c5-becc-fac397bcdf22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:48.592342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1299/2631] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:48 2022] DELETE /identity/v3/projects/de9965393a52440fa24f4577683a567d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:48.599221 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df54981-257f-4672-af13-48041fea4b08 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.599555 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df54981-257f-4672-af13-48041fea4b08 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.599827 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df54981-257f-4672-af13-48041fea4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.622277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8df54981-257f-4672-af13-48041fea4b08 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:48.623541 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8df54981-257f-4672-af13-48041fea4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:48.704648 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1333/2632] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:48.707165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.707439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.707708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.730259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:48.731619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:48.741108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1300/2633] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:48.745935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df54981-257f-4672-af13-48041fea4b08 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:48.756467 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df54981-257f-4672-af13-48041fea4b08 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.761573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.762191 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.762575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.762841 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.763493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:48.763788 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.765441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.778673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1334/2634] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:21:48.783211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:48.793144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf50b3c-0306-4c50-a7f9-6d46f97ad696 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.798550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.799257 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.799598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.799929 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.800641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.803110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.841594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1301/2635] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:48 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:48.848232 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:48.859101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c6c9-3057-4a42-ab6f-3898c6dc0927 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.931370 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.932121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.932248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.932507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.933202 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.935127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.958445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1335/2636] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:48 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:48.963166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:48.975659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9720afe-cf37-434f-884e-7bfb42628a57 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:48.980666 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:48.981324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:48.981612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:48.981896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:48.982560 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:48.984183 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:48.995975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1302/2637] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:21:49.000640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.012278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6bf9e-9bd6-47ec-8d85-1a5be0d63f33 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.018108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.018849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.019806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.020072 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.021066 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.022558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761273c4-d6db-4a1a-9a93-9e895cf30bcb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.035637 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:49.043624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1336/2638] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:49.049131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.061098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9cb99-ab12-4abe-89c7-dbff1cf6a4f3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.066805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.067396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.067677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.068026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] PATH_INFO: `/v3/projects/6970975317dd484188e9f61cbd4e9760/users/6471ce253bd2460cae959225af4ec01a/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.084545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6970975317dd484188e9f61cbd4e9760, user_id=6471ce253bd2460cae959225af4ec01a, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.087269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.102829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1303/2639] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:49 2022] PUT /identity/v3/projects/6970975317dd484188e9f61cbd4e9760/users/6471ce253bd2460cae959225af4ec01a/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:49.114675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.115017 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.115366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.150392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] MFA Rules not processed for user `6471ce253bd2460cae959225af4ec01a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:49.151692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:49.229926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1337/2640] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:49.235600 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.315819 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ff10c-8fde-4cac-be36-8466f7df4bfe admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.321713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.322401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.322722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.323070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.323814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.326094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.369342 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1304/2641] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:49 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:49.374211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.387068 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2ec2-7583-4321-aa79-bafdb10d4f8d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.473992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.474669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.474966 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.475253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.475922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.478025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.506884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1338/2642] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:49 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:49.512178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.524431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136fbb-057a-4cc9-960c-565a0a5d2a29 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.529266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.529880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.530150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.530446 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.531085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.532692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.544368 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1305/2643] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:21:49.549401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.570738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be3bf6-e980-49e4-b117-de02f7f4248b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.576391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.577339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.577707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.578076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] PATH_INFO: `/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14/users/185a70e4faf24789b2a99b5151daed57/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.595870 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea7c048af6a4ebfb45d73be9e9a2e14, user_id=185a70e4faf24789b2a99b5151daed57, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.599228 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.613301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1339/2644] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:49 2022] PUT /identity/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14/users/185a70e4faf24789b2a99b5151daed57/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:49.617658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.623176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:49.632385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927b75-f849-4153-95ec-a4cca48bf9be admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.709742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.710402 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.710681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.710947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.711616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.713331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fd007-3999-4968-820e-1fe8a5aaf197 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.725316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1306/2645] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:49.729797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.742161 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3acef5-849d-4d73-971d-e702b75c177d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.747303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.747997 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.748480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.748778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] PATH_INFO: `/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14/users/185a70e4faf24789b2a99b5151daed57/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.750971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea7c048af6a4ebfb45d73be9e9a2e14, user_id=185a70e4faf24789b2a99b5151daed57, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.754212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.767931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1340/2646] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:49 2022] PUT /identity/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14/users/185a70e4faf24789b2a99b5151daed57/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:49.779113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.779438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.779715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.809781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] MFA Rules not processed for user `185a70e4faf24789b2a99b5151daed57`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:49.811023 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:49.886227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1307/2647] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:49.900405 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:49.902479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:49.953269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:49.967708 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb155415-ad0c-421d-9f33-7d6aebf44d67 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:49.971663 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:49.972761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:49.973048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:49.973318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:49.983946 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:49.985429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:49.996300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1341/2648] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:50.098016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:50.109536 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06294dfd-93f6-4678-8048-9d48670d3625 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:50.114586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:50.115235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:50.115585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:50.115880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:50.186591 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:50.188212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09af71-759e-4b2f-ad00-ba0f7322faee service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:50.198221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1308/2649] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:57.180650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:57.257255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110e9d-c057-4487-8bba-be0a88caf21b service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:57.263364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:57.264055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:57.264330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:57.264598 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] PATH_INFO: `/v3/users/6471ce253bd2460cae959225af4ec01a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:57.265867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6471ce253bd2460cae959225af4ec01a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:57.268201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:57.318290 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6471ce253bd2460cae959225af4ec01a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.318963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6471ce253bd2460cae959225af4ec01a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.329112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6471ce253bd2460cae959225af4ec01a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.340163 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6471ce253bd2460cae959225af4ec01a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.340834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6471ce253bd2460cae959225af4ec01a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.369486 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1342/2650] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:57 2022] DELETE /identity/v3/users/6471ce253bd2460cae959225af4ec01a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:57.371602 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:57.372109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:57.372596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:57.397047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:57.398439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:57.420673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:57.470412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1309/2651] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:57.481234 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:57.482776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:57.544884 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3b884-8556-47f9-8c8e-028192d88809 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:57.548360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:57.549019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:57.549185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:57.549444 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:57.563932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:57.565666 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:57.577842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1343/2652] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:21:57.905441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:57.906992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:57.921810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0ce5-1323-4f6f-952b-dafb465ca069 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:57.928332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:57.929187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:57.929463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:57.929735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] PATH_INFO: `/v3/projects/6970975317dd484188e9f61cbd4e9760` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:57.931433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6970975317dd484188e9f61cbd4e9760)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:57.933856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:57.986384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6970975317dd484188e9f61cbd4e9760', 'request_id': 'req-36e3387b-faad-4796-86d1-ba810daf35fd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:57.994071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6970975317dd484188e9f61cbd4e9760', 'request_id': 'req-36e3387b-faad-4796-86d1-ba810daf35fd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.000424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6970975317dd484188e9f61cbd4e9760', 'request_id': 'req-36e3387b-faad-4796-86d1-ba810daf35fd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.018562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] The token cache is being invalidate because project 6970975317dd484188e9f61cbd4e9760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:58.018970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.019691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.021548 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1310/2653] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:57 2022] DELETE /identity/v3/projects/6970975317dd484188e9f61cbd4e9760 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:58.025525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.036175 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e478de2-0b3f-4a1b-bc76-b95cb9b47780 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.040188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.102186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:58.102712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.102979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.103244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] PATH_INFO: `/v3/users/185a70e4faf24789b2a99b5151daed57` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.104362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=185a70e4faf24789b2a99b5151daed57)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:58.106854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:58.160096 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185a70e4faf24789b2a99b5151daed57'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.160778 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185a70e4faf24789b2a99b5151daed57'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.167692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185a70e4faf24789b2a99b5151daed57'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.176441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185a70e4faf24789b2a99b5151daed57'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.177206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1096badb-8c1a-4403-8384-950d20fd03ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185a70e4faf24789b2a99b5151daed57'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.196634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1344/2654] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:21:58 2022] DELETE /identity/v3/users/185a70e4faf24789b2a99b5151daed57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:58.482920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.484469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:58.498659 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3387b-faad-4796-86d1-ba810daf35fd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.560610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:58.561277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.561545 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.561890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] PATH_INFO: `/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.562995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea7c048af6a4ebfb45d73be9e9a2e14)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:58.565213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:58.617152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.618551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea7c048af6a4ebfb45d73be9e9a2e14', 'request_id': 'req-85799a91-86cc-4594-9f3a-8d68051db3e9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.627995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea7c048af6a4ebfb45d73be9e9a2e14', 'request_id': 'req-85799a91-86cc-4594-9f3a-8d68051db3e9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.634748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea7c048af6a4ebfb45d73be9e9a2e14', 'request_id': 'req-85799a91-86cc-4594-9f3a-8d68051db3e9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.649328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] The token cache is being invalidate because project 0ea7c048af6a4ebfb45d73be9e9a2e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:21:58.649613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.650289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85799a91-86cc-4594-9f3a-8d68051db3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:21:58.651738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1311/2655] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:21:58 2022] DELETE /identity/v3/projects/0ea7c048af6a4ebfb45d73be9e9a2e14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:58.656726 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.657113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.657307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.680206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:58.681491 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:58.749014 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1345/2656] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:58.757282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.757558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.757832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.781066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:58.782304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:58.791269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1312/2657] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:58.796021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.806864 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825eec7-773a-4170-abd2-7afeb92355be None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.811867 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:58.812485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.812797 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.813397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.813711 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:21:58.814008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:58.816588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:58.831027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1346/2658] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:21:58.834459 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.844353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e649b-0971-41c1-bb6e-9494fa66f3ee None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.850483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:58.851109 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.851403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.851651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.852302 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:58.854286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:58.886153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1313/2659] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:58 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:58.890631 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:58.902346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573f79-39d0-4667-ae1c-b14a2a61e08e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:58.918837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:58.994329 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75289906-8516-4464-b754-658546f76e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:58.995156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75289906-8516-4464-b754-658546f76e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:58.995425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75289906-8516-4464-b754-658546f76e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:58.995693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75289906-8516-4464-b754-658546f76e30 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:58.996338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75289906-8516-4464-b754-658546f76e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:58.998427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75289906-8516-4464-b754-658546f76e30 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.027928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1347/2660] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:58 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:59.032712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.045158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e75fb-959e-422d-a6bb-14bdd4325029 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.050791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.051538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.051988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.052372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.053204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.055038 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.067393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1314/2661] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:59.072699 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75289906-8516-4464-b754-658546f76e30 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.084558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75289906-8516-4464-b754-658546f76e30 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.089678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.090615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.091046 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.091365 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.092087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.093912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8638ec-72a6-47c9-90d1-1e4adf2f0283 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.107721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1348/2662] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:59.113345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.126304 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcab7-a631-4e96-95e8-7e1cc810c8cf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.132920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.133711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.134140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.134576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] PATH_INFO: `/v3/projects/af28049a05584b969ed61c73e5f199e2/users/2ffa313771e243a5913d32541ae60297/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.153763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=af28049a05584b969ed61c73e5f199e2, user_id=2ffa313771e243a5913d32541ae60297, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.156462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.170358 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1315/2663] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:59 2022] PUT /identity/v3/projects/af28049a05584b969ed61c73e5f199e2/users/2ffa313771e243a5913d32541ae60297/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:59.182016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.182407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.182756 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.215322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] MFA Rules not processed for user `2ffa313771e243a5913d32541ae60297`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:59.216530 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:59.287328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1349/2664] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:59.291978 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.363327 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17843d3-46fe-419f-bc1a-b252a3977cee admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.368472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.369752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.370047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.370278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.370943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.372892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.402917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1316/2665] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:21:59 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:59.407159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.418861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9415c-b223-4c02-bb28-73f5a433c0f7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.476064 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.476679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.477013 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.477244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.477931 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.479848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.503700 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1350/2666] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:21:59 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:21:59.507839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.518403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c69dfb-1d3a-49b7-bae4-a2a39c488a5f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.523687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.524295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.524568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.524862 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.525511 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.527115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.538690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1317/2667] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:59.543603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.554479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0ec54-32cb-4365-9400-cf96b4f9408a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.559991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.560665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.560971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.561244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] PATH_INFO: `/v3/projects/48c566198d514145a7b1c8e6160408ae/users/8f544ebb1a3d44748cd8a61e4a6bc2f7/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.571375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.579632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c566198d514145a7b1c8e6160408ae, user_id=8f544ebb1a3d44748cd8a61e4a6bc2f7, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.582698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.598558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1351/2668] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:59 2022] PUT /identity/v3/projects/48c566198d514145a7b1c8e6160408ae/users/8f544ebb1a3d44748cd8a61e4a6bc2f7/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:59.602960 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.614874 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdc0e8-7fb6-4f14-a16a-f11a6edee228 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.670381 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:21:59.689315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.689982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.690748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.690748 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.691233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.693026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4022-0d2e-4a95-abef-89a346b1b35d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.703260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1318/2669] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:21:59.708548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.724195 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde631-1fd3-473c-bb6f-72b06562e49a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.729029 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.729703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.729965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.730249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] PATH_INFO: `/v3/projects/48c566198d514145a7b1c8e6160408ae/users/8f544ebb1a3d44748cd8a61e4a6bc2f7/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.732339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c566198d514145a7b1c8e6160408ae, user_id=8f544ebb1a3d44748cd8a61e4a6bc2f7, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.735033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.748129 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1352/2670] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:21:59 2022] PUT /identity/v3/projects/48c566198d514145a7b1c8e6160408ae/users/8f544ebb1a3d44748cd8a61e4a6bc2f7/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:21:59.762397 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.762770 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.763117 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.795340 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] MFA Rules not processed for user `8f544ebb1a3d44748cd8a61e4a6bc2f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:21:59.797041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:59.882398 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1319/2671] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:21:59.894358 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:21:59.896371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:21:59.960570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302393-eeaa-4d0f-8e95-0295fc66f3c8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:21:59.965550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:21:59.968016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:21:59.968016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:21:59.968016 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:21:59.979581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:21:59.981073 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00732d9-0c0c-413d-9aef-7cd7ddff3171 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:21:59.992272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1353/2672] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:21:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:01.529514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:01.628444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06668e-cf6a-4aff-a819-2ed328eaafc0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:01.635662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:01.636415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:01.636732 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:01.637400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] PATH_INFO: `/v3/users/2ffa313771e243a5913d32541ae60297` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:01.638646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffa313771e243a5913d32541ae60297)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:01.640596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:01.696826 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffa313771e243a5913d32541ae60297'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:01.704293 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffa313771e243a5913d32541ae60297'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:01.714959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:01.718165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffa313771e243a5913d32541ae60297'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:01.719014 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffa313771e243a5913d32541ae60297'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:01.719630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffa313771e243a5913d32541ae60297'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:01.737064 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1320/2673] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:01 2022] DELETE /identity/v3/users/2ffa313771e243a5913d32541ae60297 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:01.742084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:01.742649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:01.742749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:01.765428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:01.766654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:01.838964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1354/2674] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:01.850318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:01.851799 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:01.924801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae153e-b95c-4b2f-8add-a8ca5f1cda8b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:01.929112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:01.929756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:01.930005 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:01.930297 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:01.941205 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:01.942716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:01.954202 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1321/2675] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:02.368740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:02.371260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:02.389846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418c7ce-df1d-4cd0-85b3-8d7fa3d19016 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:02.398576 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:02.399787 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:02.400418 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:02.401055 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] PATH_INFO: `/v3/projects/af28049a05584b969ed61c73e5f199e2` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:02.403861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af28049a05584b969ed61c73e5f199e2)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:02.409675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:02.512098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af28049a05584b969ed61c73e5f199e2', 'request_id': 'req-ef60f514-8629-4bca-839e-78006e121a45'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.523488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af28049a05584b969ed61c73e5f199e2', 'request_id': 'req-ef60f514-8629-4bca-839e-78006e121a45'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.533770 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af28049a05584b969ed61c73e5f199e2', 'request_id': 'req-ef60f514-8629-4bca-839e-78006e121a45'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.548061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:02.555692 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] The token cache is being invalidate because project af28049a05584b969ed61c73e5f199e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:02.556113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.558445 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.560579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1355/2676] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:02 2022] DELETE /identity/v3/projects/af28049a05584b969ed61c73e5f199e2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:02.572682 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:02.587944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ce824-c718-4de8-aa0c-26ddaac56085 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:02.680232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:02.681214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:02.681643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:02.683033 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] PATH_INFO: `/v3/users/8f544ebb1a3d44748cd8a61e4a6bc2f7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:02.684696 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f544ebb1a3d44748cd8a61e4a6bc2f7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:02.687303 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:02.766993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f544ebb1a3d44748cd8a61e4a6bc2f7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.783103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f544ebb1a3d44748cd8a61e4a6bc2f7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.813026 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f544ebb1a3d44748cd8a61e4a6bc2f7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.814518 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f544ebb1a3d44748cd8a61e4a6bc2f7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.815153 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1b13b5bd-1f7e-434d-b5e8-d72da6b85ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f544ebb1a3d44748cd8a61e4a6bc2f7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:02.843286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1322/2677] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:02 2022] DELETE /identity/v3/users/8f544ebb1a3d44748cd8a61e4a6bc2f7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:03.263927 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.265757 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.288282 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f514-8629-4bca-839e-78006e121a45 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:03.355496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:03.356166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.356451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.356814 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] PATH_INFO: `/v3/projects/48c566198d514145a7b1c8e6160408ae` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.358058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c566198d514145a7b1c8e6160408ae)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:03.360010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:03.430871 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c566198d514145a7b1c8e6160408ae', 'request_id': 'req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.439678 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c566198d514145a7b1c8e6160408ae', 'request_id': 'req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.447125 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c566198d514145a7b1c8e6160408ae', 'request_id': 'req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.463772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] The token cache is being invalidate because project 48c566198d514145a7b1c8e6160408ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:03.464032 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.464852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b843d3a4-7afc-4db3-8013-42b9dc0ee78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.466437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1356/2678] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:03 2022] DELETE /identity/v3/projects/48c566198d514145a7b1c8e6160408ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:03.472559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.473111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.473445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.500460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:03.502486 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.508708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:03.589438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1323/2679] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:03.601237 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.601527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.601799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.602393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.603906 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.618886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9c455-f3a7-4d1b-91e7-9eb52fd24666 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:03.626597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:03.627385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.627783 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.628238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] PATH_INFO: `/v3/users/edd522a6c4004c33ad65e066462e12e6` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.630785 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd522a6c4004c33ad65e066462e12e6)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:03.636100 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:03.649683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:03.650537 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.666861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1357/2680] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:03.670763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.704022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36caa4-6c82-4d2d-a419-95d56f755f25 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:03.705377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd522a6c4004c33ad65e066462e12e6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.711372 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:03.712141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.712620 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.713001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.714253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:03.714955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:03.716061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd522a6c4004c33ad65e066462e12e6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.716775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:03.735007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd522a6c4004c33ad65e066462e12e6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.735797 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd522a6c4004c33ad65e066462e12e6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.736447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af43381-45cc-4f1d-8497-ef73db517537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd522a6c4004c33ad65e066462e12e6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:03.745373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1358/2681] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:03.746993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.748775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.761334 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1324/2682] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:03 2022] DELETE /identity/v3/users/edd522a6c4004c33ad65e066462e12e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:03.766051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.766473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.766835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.774599 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c0306-c9d9-4902-b020-87a2374bb257 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:03.795210 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:03.796407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.863501 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:03.864138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:03.864416 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:03.865422 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:03.865959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:03.867888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:03.888292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1325/2683] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:03.888538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:03.899146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.902834 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:03.909775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1359/2684] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:03 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:03.914455 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:03.957776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:04.006852 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eef9f9-a66f-44d7-a789-9408b2ec66a0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.011987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986612f0-dd7a-4f81-9b6d-9dfdc78c389b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.017657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.017657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.018701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.019121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.019856 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.021846 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.052937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1360/2685] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:03 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:04.057822 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.072619 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb3d9-b74c-47b5-bafa-21aa8acaafb1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.077659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.078340 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.078687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.079022 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.079795 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.082601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.095691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1361/2686] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:04.098230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.108035 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.109439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.109982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.110571 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.112473 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a0dbb-219d-4a8d-ac11-153ef24c7538 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.118842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.119519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.119799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.120173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.120976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.122634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.124703 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.126704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93633f-149b-439f-8acf-a1059971ab4d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.137568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1362/2687] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:04.141317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.145628 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1326/2688] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:04.152799 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba32-1d58-43d0-aa20-3882da0f5437 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.161409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.162183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.162994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.163270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] PATH_INFO: `/v3/projects/94f123b5686942a498f133f9215a9cf0/users/7ae881f806ec47568ea36daff51068f3/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.185472 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f123b5686942a498f133f9215a9cf0, user_id=7ae881f806ec47568ea36daff51068f3, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.188832 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.208573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1363/2689] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:04 2022] PUT /identity/v3/projects/94f123b5686942a498f133f9215a9cf0/users/7ae881f806ec47568ea36daff51068f3/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:04.220073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.220566 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.221074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.279103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] MFA Rules not processed for user `7ae881f806ec47568ea36daff51068f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:04.281211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.428099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1327/2690] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:04.433208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.508428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b02b-ee10-4363-b7b9-30ae18b48532 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.514989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.516796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.531496 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.532343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.532677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.532873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.533543 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.536250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fc5f3-0af9-4cf9-827c-c017e54492a8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.542835 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.545018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.546096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.546372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.546637 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] PATH_INFO: `/v3/projects/ec06331adfbe4b0b89eeddac2dc48715` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.548216 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec06331adfbe4b0b89eeddac2dc48715)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.551194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.588244 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1364/2691] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:04.592681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.615889 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec06331adfbe4b0b89eeddac2dc48715', 'request_id': 'req-77ae64a6-f2ac-400e-a2e9-28061fe770fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:04.623400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec06331adfbe4b0b89eeddac2dc48715', 'request_id': 'req-77ae64a6-f2ac-400e-a2e9-28061fe770fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:04.625260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:04.643169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec06331adfbe4b0b89eeddac2dc48715', 'request_id': 'req-77ae64a6-f2ac-400e-a2e9-28061fe770fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:04.644832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:04.652768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] The token cache is being invalidate because project ec06331adfbe4b0b89eeddac2dc48715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:04.653235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:04.654920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77ae64a6-f2ac-400e-a2e9-28061fe770fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:04.658085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1328/2692] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:04 2022] DELETE /identity/v3/projects/ec06331adfbe4b0b89eeddac2dc48715 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:04.664056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c7fcf-0404-44f7-8e1d-b885a832e033 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.664468 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c7fcf-0404-44f7-8e1d-b885a832e033 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.664802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c7fcf-0404-44f7-8e1d-b885a832e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.677178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf9f93-27de-455a-9e59-1e5da3c095fe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.697499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b61c7fcf-0404-44f7-8e1d-b885a832e033 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:04.698702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b61c7fcf-0404-44f7-8e1d-b885a832e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.748943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.749935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.750495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.750766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.751401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.753581 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.767538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1329/2693] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:04.776487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.776899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.777252 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.778091 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1365/2694] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:04.781964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.783602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.795932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9812-5a72-4db0-be0c-87c1597ef049 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.801101 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.801250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:04.801713 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.801980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.802283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.802413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:04.802875 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.804446 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.811047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1330/2695] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:04.818484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1366/2696] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:04.818684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.819428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.825467 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98bd6-fd09-45ed-8459-a37fe0c2b110 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.830397 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7d9ac-b27d-439b-b9b7-b7f3df57fc53 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.830911 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.831505 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.831777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.832113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.833072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:04.833374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.835022 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.835668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.836343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.836863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.837140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] PATH_INFO: `/v3/projects/b9333e0e903b4dd58cbd68441c99fd48/users/56ca030b3a8f4ad7b3c80447fa19578f/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.847995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1331/2697] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:22:04.853168 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.854724 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9333e0e903b4dd58cbd68441c99fd48, user_id=56ca030b3a8f4ad7b3c80447fa19578f, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.857497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.864410 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abca25-b6e2-4f90-a209-b38ca0c9ce6f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.869700 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.870507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.870780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.871051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.871735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.873695 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:04.874809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1367/2698] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:04 2022] PUT /identity/v3/projects/b9333e0e903b4dd58cbd68441c99fd48/users/56ca030b3a8f4ad7b3c80447fa19578f/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:04.879002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.905289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1332/2699] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:04.910118 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:04.954660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4316b-1f6f-41dc-80bc-19d285ba8b1a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.987969 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cfc1e-9959-4181-9e4d-a2edf0531e69 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:04.989116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:04.994034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:04.994868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:04.995260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:04.995531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:04.996170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:04.998158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.024526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.025220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.025497 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.025792 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.026441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.027432 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1333/2700] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:04 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:05.031588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.031952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.044213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4db5e8-8b3d-4fd7-b017-b92f7f246b13 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.047914 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1368/2701] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:05.049279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.054116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.055004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.055307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.055307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.056015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.057938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.060943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccf53-ef2d-46dc-96dc-8bb12bea21f2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.068182 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.068990 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.069193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.069489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] PATH_INFO: `/v3/projects/b9333e0e903b4dd58cbd68441c99fd48/users/56ca030b3a8f4ad7b3c80447fa19578f/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.070551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1334/2702] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:05.071683 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9333e0e903b4dd58cbd68441c99fd48, user_id=56ca030b3a8f4ad7b3c80447fa19578f, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.074480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7d393-5ef3-4206-904d-3deee7030178 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.074650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.086334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1369/2703] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:05 2022] PUT /identity/v3/projects/b9333e0e903b4dd58cbd68441c99fd48/users/56ca030b3a8f4ad7b3c80447fa19578f/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:05.086759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973da14d-8c9c-4cdc-832a-3be4bd120a30 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.098457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.098740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.099035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.122763 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:05.129855 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] MFA Rules not processed for user `56ca030b3a8f4ad7b3c80447fa19578f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:05.131254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.161270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.161900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.162166 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.162513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.163619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.165298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.176488 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1335/2704] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:05.180735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.191169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b8f4-e80b-41b1-9e0b-319c1d17c51d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.196887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.197567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.197847 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.198186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] PATH_INFO: `/v3/projects/05c41f633e3b4682b93ebe5b55d93509/users/22b7ec0cae184bd5b69f87c0976456a4/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.211176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1370/2705] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:05.217718 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c41f633e3b4682b93ebe5b55d93509, user_id=22b7ec0cae184bd5b69f87c0976456a4, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.220577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6020a2-7803-480c-9efc-c607608005e0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.224058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.225229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.235258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1336/2706] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:05 2022] PUT /identity/v3/projects/05c41f633e3b4682b93ebe5b55d93509/users/22b7ec0cae184bd5b69f87c0976456a4/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:05.246194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.246521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.246754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.276409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] MFA Rules not processed for user `22b7ec0cae184bd5b69f87c0976456a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:05.277709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.301020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5520198-fdfd-43eb-907f-f4990eb3cb15 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.352660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.353214 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.353484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.354015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.354170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1337/2707] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:05.364697 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:05.365362 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.367008 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.380618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57c1d7-fc32-4379-9255-73249d4e60c7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.384668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.385308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.385568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.385836 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.395044 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.396507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.406198 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1338/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:05.424779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.426495 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc51b1e-33b0-42cd-8ef4-ca810e650f3d service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.436346 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1371/2709] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:05.511374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.586716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebcbba-bdd2-4593-bcb8-8f9e61cb5cb4 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.592776 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.593441 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.593721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.593993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] PATH_INFO: `/v3/users/7ae881f806ec47568ea36daff51068f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.595189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae881f806ec47568ea36daff51068f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.598413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.624208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:05.672649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae881f806ec47568ea36daff51068f3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:05.691687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae881f806ec47568ea36daff51068f3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:05.717868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae881f806ec47568ea36daff51068f3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:05.719196 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae881f806ec47568ea36daff51068f3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:05.720052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae881f806ec47568ea36daff51068f3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:05.747931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1339/2710] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:05 2022] DELETE /identity/v3/users/7ae881f806ec47568ea36daff51068f3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:05.750311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.750551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.750978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.772586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:05.773962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.844830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1372/2711] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:05.857804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:05.859281 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:05.929584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84eea9-23a8-4a9c-972c-8c6aeadef3b4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:05.933474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:05.934102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:05.934400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:05.934668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:05.945032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:05.946485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:05.957585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1340/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:06.331474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:06.333189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:06.346114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6546c-80fc-494a-b875-d6b35e1db751 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:06.353425 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:06.354173 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:06.354510 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:06.355019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] PATH_INFO: `/v3/projects/94f123b5686942a498f133f9215a9cf0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:06.356230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f123b5686942a498f133f9215a9cf0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:06.358632 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:06.416707 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f123b5686942a498f133f9215a9cf0', 'request_id': 'req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.423098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f123b5686942a498f133f9215a9cf0', 'request_id': 'req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.428853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f123b5686942a498f133f9215a9cf0', 'request_id': 'req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.443314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] The token cache is being invalidate because project 94f123b5686942a498f133f9215a9cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:06.443971 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.444300 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6d9dcbd-1a7d-4f6d-a07d-bbc5aa62bf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.446099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1373/2713] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:06 2022] DELETE /identity/v3/projects/94f123b5686942a498f133f9215a9cf0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:06.450289 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:06.461195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555c006-2357-4dec-a468-5f1c7d22d8fc service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:06.523711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:06.524351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:06.524633 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:06.524940 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] PATH_INFO: `/v3/users/56ca030b3a8f4ad7b3c80447fa19578f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:06.526128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ca030b3a8f4ad7b3c80447fa19578f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:06.528062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:06.575524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:06.578513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ca030b3a8f4ad7b3c80447fa19578f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.587439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ca030b3a8f4ad7b3c80447fa19578f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.600586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ca030b3a8f4ad7b3c80447fa19578f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.601413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ca030b3a8f4ad7b3c80447fa19578f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.602151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ca030b3a8f4ad7b3c80447fa19578f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:06.616688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1341/2714] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:06 2022] DELETE /identity/v3/users/56ca030b3a8f4ad7b3c80447fa19578f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:06.864009 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037119-78de-4652-9959-4fd55f8ff39b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:06.864316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037119-78de-4652-9959-4fd55f8ff39b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:06.864522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037119-78de-4652-9959-4fd55f8ff39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:06.886256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5d037119-78de-4652-9959-4fd55f8ff39b None None] MFA Rules not processed for user `22b7ec0cae184bd5b69f87c0976456a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:06.887703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5d037119-78de-4652-9959-4fd55f8ff39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:06.915766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:06.917635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:06.923351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:06.965246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1374/2715] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:06.999313 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509317d8-ffcd-4812-90fd-22488ea44c28 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.005919 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.006577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.006854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.007129 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] PATH_INFO: `/v3/projects/b9333e0e903b4dd58cbd68441c99fd48` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.008474 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9333e0e903b4dd58cbd68441c99fd48)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.010435 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.072516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9333e0e903b4dd58cbd68441c99fd48', 'request_id': 'req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:07.079323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9333e0e903b4dd58cbd68441c99fd48', 'request_id': 'req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:07.085805 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9333e0e903b4dd58cbd68441c99fd48', 'request_id': 'req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:07.100073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] The token cache is being invalidate because project b9333e0e903b4dd58cbd68441c99fd48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:07.100357 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:07.101029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4eb2d35-8b38-4e86-bb7e-5b9bae61ae25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:07.102553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1342/2716] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:06 2022] DELETE /identity/v3/projects/b9333e0e903b4dd58cbd68441c99fd48 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:07.107515 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.107798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.108095 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.129627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:07.130655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:07.215053 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1375/2717] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:07.216989 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.217473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.217720 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.239541 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:07.240825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:07.250006 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1343/2718] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:07.254669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.265442 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1621b-932c-4fc0-915c-ea38d0e2d84d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.271089 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.271718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.271989 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.272260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.272964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:07.273269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.275311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.290469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1376/2719] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:07.295057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.305003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1479-ab41-46a5-ab44-f7ff7d1716b6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.310433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.311185 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.311298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.311575 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.312227 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.314256 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.356538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1344/2720] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/projects => generated 407 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:07.360857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.386170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73261620-11f9-44ab-ad44-b53377293863 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.446063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.446766 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.447044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.447236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.447844 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.449809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.477109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1377/2721] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/users => generated 304 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:07.478691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.490261 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b890-d95f-4a9f-8bf3-6a05334d9b6f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.497508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.498245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.498569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.498912 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.499613 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.501315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.515738 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1345/2722] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:07.516958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.527728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582707d2-cabd-45c2-b54a-4be7609c498f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.534524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.534854 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.535267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.535675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.536315 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.538920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009c4f6-ee72-4c43-87db-a3036714677d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.552655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1378/2723] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:07.557245 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.568664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e70e-ada5-4948-aa7b-e5c49a2926f4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.575782 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.576480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.576737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.577061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] PATH_INFO: `/v3/projects/2fd5332343814617a5d531d8bd746dcd/users/2ded2177203845159e35d3778823516c/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.587475 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:07.596466 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd5332343814617a5d531d8bd746dcd, user_id=2ded2177203845159e35d3778823516c, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.600610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.617821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1346/2724] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:07 2022] PUT /identity/v3/projects/2fd5332343814617a5d531d8bd746dcd/users/2ded2177203845159e35d3778823516c/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:07.630720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.631070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.631468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.665961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] MFA Rules not processed for user `2ded2177203845159e35d3778823516c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:07.667275 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:07.709128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:07.756400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1379/2725] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:07.761448 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.833559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a04723-ccf9-4821-bb4b-868479b766c7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.839156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.839764 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.840039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.840305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.840974 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.842984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.873112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1347/2726] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:07.876897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.891217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f88cf-9e2b-4df6-8b31-51eea55b1819 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:07.951033 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:07.951654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:07.951936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:07.952651 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:07.953333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:07.955277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:07.981588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1380/2727] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:07 2022] POST /identity/v3/users => generated 310 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:07.986034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:07.999065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a884-23a4-4733-9daf-4c4f4ed7d8aa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.004200 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.004868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.005190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.005461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.006125 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.007811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.019837 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1348/2728] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:08.024112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.034483 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb6e5-d8d6-43c7-8242-e7996a62e5c0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.040119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.040514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.040887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.041226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] PATH_INFO: `/v3/projects/67c5028b7a4741a1ab60e6e31112c095/users/8606d8828e0b4febb31631c94a8f3989/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.058026 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c5028b7a4741a1ab60e6e31112c095, user_id=8606d8828e0b4febb31631c94a8f3989, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.060874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.081572 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1381/2729] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:08 2022] PUT /identity/v3/projects/67c5028b7a4741a1ab60e6e31112c095/users/8606d8828e0b4febb31631c94a8f3989/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:08.086077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.098669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d759d-12cf-4036-8a28-577a8128a978 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.186391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.186584 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.186885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.187120 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.187773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.190423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9f3a4-01f2-4f9e-b469-8251df9d7e3f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.203579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1349/2730] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:08.208109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.220718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf6a68-da7d-4596-b0ea-1ee9a21aa5c6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.226728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.227403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.227675 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.227943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] PATH_INFO: `/v3/projects/67c5028b7a4741a1ab60e6e31112c095/users/8606d8828e0b4febb31631c94a8f3989/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.229893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c5028b7a4741a1ab60e6e31112c095, user_id=8606d8828e0b4febb31631c94a8f3989, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.232627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.246306 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1382/2731] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:08 2022] PUT /identity/v3/projects/67c5028b7a4741a1ab60e6e31112c095/users/8606d8828e0b4febb31631c94a8f3989/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:08.256550 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.256858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.257131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.289372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] MFA Rules not processed for user `8606d8828e0b4febb31631c94a8f3989`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:08.290611 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:08.342395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:08.378393 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1350/2732] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:08 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:08.390093 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.391630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:08.458729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17099-edd1-4d3e-b01f-1eaebefbdf0d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.462963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.463984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.463984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.467348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.482728 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.484160 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.495558 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1383/2733] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:08.760493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:08.776902 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ddde-844d-4265-b0e4-7331d55e5eee None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:08.791516 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:08.792144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:08.792415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:08.792678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:08.857947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:08.859439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e4a01-42ce-4aef-891a-018e2d35795f service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:08.869419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1351/2734] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:11.989468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:11.993267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:12.080313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:12.242551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0c896-54e8-4880-91ce-776e2e2fea21 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:12.256098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5df08926dfe44f3ac00d11414e3513e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:12.257837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:12.258307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:12.259716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:12.263978 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:12.389772 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:12.395375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:12.413793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1384/2735] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:14.638495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105212f-dfb9-4bc6-b7d4-32324f9def16 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:14.639116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105212f-dfb9-4bc6-b7d4-32324f9def16 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:14.639116 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105212f-dfb9-4bc6-b7d4-32324f9def16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:14.660802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4105212f-dfb9-4bc6-b7d4-32324f9def16 None None] MFA Rules not processed for user `5baeae00a21f4b26b7ede28c998b31bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:14.662051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4105212f-dfb9-4bc6-b7d4-32324f9def16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:14.725101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1352/2736] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:14.986035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:15.071239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafc7f4-7316-4cf0-abac-f41ca429b6b1 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:15.076806 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:15.077531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:15.077815 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:15.078238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] PATH_INFO: `/v3/users/2ded2177203845159e35d3778823516c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:15.079705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ded2177203845159e35d3778823516c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:15.084435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:15.145113 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:15.160302 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ded2177203845159e35d3778823516c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:15.161703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ded2177203845159e35d3778823516c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:15.174769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ded2177203845159e35d3778823516c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:15.185828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ded2177203845159e35d3778823516c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:15.186887 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ded2177203845159e35d3778823516c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:15.212825 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1385/2737] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:14 2022] DELETE /identity/v3/users/2ded2177203845159e35d3778823516c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:15.217843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:15.217843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:15.217843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:15.247903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:15.249207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:15.326052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1353/2738] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:15.351657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:15.354436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:15.446828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f67d5-afab-414b-b531-824fd792f220 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:15.451874 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:15.452655 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:15.453048 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:15.453364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:15.464513 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:15.466063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:15.478483 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1386/2739] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:15.999875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:16.001829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:16.018999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4090e-7d62-4f87-8205-f2da8b37744f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:16.032860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:16.035617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:16.036132 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:16.036849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] PATH_INFO: `/v3/projects/2fd5332343814617a5d531d8bd746dcd` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:16.038931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd5332343814617a5d531d8bd746dcd)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:16.041562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:16.085685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:16.127547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd5332343814617a5d531d8bd746dcd', 'request_id': 'req-5f84c2a5-f537-4920-8a94-ffec51edbe60'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.134955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd5332343814617a5d531d8bd746dcd', 'request_id': 'req-5f84c2a5-f537-4920-8a94-ffec51edbe60'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.141857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd5332343814617a5d531d8bd746dcd', 'request_id': 'req-5f84c2a5-f537-4920-8a94-ffec51edbe60'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.156190 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] The token cache is being invalidate because project 2fd5332343814617a5d531d8bd746dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:16.156483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.157323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.159186 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1354/2740] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:15 2022] DELETE /identity/v3/projects/2fd5332343814617a5d531d8bd746dcd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:16.163138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:16.175905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549e82-4932-4a03-b8af-56d91d8bc084 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:16.285054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:16.285054 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:16.305938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:16.306686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:16.306872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:16.307144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] PATH_INFO: `/v3/users/8606d8828e0b4febb31631c94a8f3989` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:16.309207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8606d8828e0b4febb31631c94a8f3989)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:16.312869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:16.406186 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8606d8828e0b4febb31631c94a8f3989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.406857 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8606d8828e0b4febb31631c94a8f3989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.416428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8606d8828e0b4febb31631c94a8f3989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.421595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:16.441925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8606d8828e0b4febb31631c94a8f3989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.442798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8606d8828e0b4febb31631c94a8f3989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:16.463111 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c2a5-f537-4920-8a94-ffec51edbe60 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:16.468407 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:16.469071 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:16.469350 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:16.469616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:16.472279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1387/2741] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:16 2022] DELETE /identity/v3/users/8606d8828e0b4febb31631c94a8f3989 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:16.473356 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:16.487538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:16.489260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf5ffa-20ac-4775-8c75-c313ab3a50f4 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:16.502751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1355/2742] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:16.934836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:16.936347 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:17.090201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e395-542a-41b1-9301-433a7ea25f27 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.098005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.098949 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.100140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.100574 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] PATH_INFO: `/v3/projects/67c5028b7a4741a1ab60e6e31112c095` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.107907 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c5028b7a4741a1ab60e6e31112c095)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.109921 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.187146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c5028b7a4741a1ab60e6e31112c095', 'request_id': 'req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:17.197910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c5028b7a4741a1ab60e6e31112c095', 'request_id': 'req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:17.208833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c5028b7a4741a1ab60e6e31112c095', 'request_id': 'req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:17.232704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] The token cache is being invalidate because project 67c5028b7a4741a1ab60e6e31112c095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:17.233019 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:17.233811 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b903ceae-dd64-4f8b-a2e3-cd0a39955cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:17.235386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1388/2743] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:16 2022] DELETE /identity/v3/projects/67c5028b7a4741a1ab60e6e31112c095 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:17.241529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.242007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.242103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.263802 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:17.265207 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:17.336559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1356/2744] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:17.344551 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.344895 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.345167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.367424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:17.368660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:17.378206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1389/2745] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:17.382734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.394099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b16bce-4140-4d46-b425-1860d0d85aef None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.399948 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.400568 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.400891 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.401169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.401831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:17.402131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.403854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.417433 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1357/2746] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:17.422015 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.433749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5536-d47a-4bdb-8e56-2c3fe10244fb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.440798 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.441604 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.441843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.442309 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.442964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.445090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.478843 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1390/2747] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:17.484504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.496786 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97a46-83dc-4d76-953b-849ca8579716 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.501155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:17.563959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.564484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.564773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.565484 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.565691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.567806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.592460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1358/2748] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:17.597662 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.609505 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb183-3749-48f1-9843-417854295ef5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.614996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.615640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.615944 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.616208 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.616926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.618538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.631813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1391/2749] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:17.635244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.648963 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967735d-ec77-4290-9733-adc4a039afa6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.654923 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.655694 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.656099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.656465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.657286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.659971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785f03b-3095-4d78-adfa-3b5504625245 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.676798 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1359/2750] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:17.679139 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.695476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b87752-ad60-4c71-ab6b-1e73d2fa4e25 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:17.705563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:17.706761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.707507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.707681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] PATH_INFO: `/v3/projects/b7585d9478834cedb03c61e4d8b630b0/users/39902b0db93446579f88aee90810ae69/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.732409 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7585d9478834cedb03c61e4d8b630b0, user_id=39902b0db93446579f88aee90810ae69, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:17.735283 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:17.754610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1392/2751] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:17 2022] PUT /identity/v3/projects/b7585d9478834cedb03c61e4d8b630b0/users/39902b0db93446579f88aee90810ae69/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:17.768490 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:17.768895 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:17.769353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:17.810406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] MFA Rules not processed for user `39902b0db93446579f88aee90810ae69`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:17.811980 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:17.911170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1360/2752] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:17.916554 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:17.924560 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:18.023269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac3d2e-b8f6-4e97-a932-a57787ee82c5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.028082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.028689 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.029088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.029262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.029890 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.031774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.063211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1393/2753] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:17 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:18.068053 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.079966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321161fe-f6ff-4cdd-8b6e-6e742671c569 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.168595 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.169409 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.169809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.169951 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.170586 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.172967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.202607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1361/2754] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:18 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:18.204650 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.217415 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021abe3-5b96-4d08-abc1-c447a3524d64 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.224007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.224836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.225121 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.225395 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.226061 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.227668 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.259716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.264812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1394/2755] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:18.267098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:18.272863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195c4f-7ed4-4f5d-a810-17ecf4f4efcd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.280724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.281733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.281733 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.281988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] PATH_INFO: `/v3/projects/53ccfef2bc274c26a3a127f830a06077/users/4be322576b7b4f02bcbc93638893c05b/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.300277 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ccfef2bc274c26a3a127f830a06077, user_id=4be322576b7b4f02bcbc93638893c05b, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.302856 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.322317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1362/2756] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:18 2022] PUT /identity/v3/projects/53ccfef2bc274c26a3a127f830a06077/users/4be322576b7b4f02bcbc93638893c05b/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:18.326441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.337664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e808e-89a7-44b7-a431-92de3370b174 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.421249 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.421976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.422387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.422742 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.423909 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.426716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481a5da-4ad2-4f6e-bc94-5741ad19d90f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.449396 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1395/2757] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:18.453877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.466148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce555ed3-9e2d-4bd9-963c-81b06433d055 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.473124 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.474149 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.474554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.475009 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] PATH_INFO: `/v3/projects/53ccfef2bc274c26a3a127f830a06077/users/4be322576b7b4f02bcbc93638893c05b/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.477248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ccfef2bc274c26a3a127f830a06077, user_id=4be322576b7b4f02bcbc93638893c05b, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.479937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.496803 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1363/2758] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:18 2022] PUT /identity/v3/projects/53ccfef2bc274c26a3a127f830a06077/users/4be322576b7b4f02bcbc93638893c05b/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:18.507159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.507600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.508021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.543328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] MFA Rules not processed for user `4be322576b7b4f02bcbc93638893c05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:18.544411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:18.621725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.624296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:18.654916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:18.669906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1396/2759] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:18.676330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:18.679390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:18.721648 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd9e8-7f8d-49c1-89ec-4187a5cc315e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.726004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.726644 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.727001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.727268 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.729678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:18.763488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c88fd-41be-4368-9157-0e0bc3b5c434 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:18.769301 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:18.769943 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:18.770219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:18.770503 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:18.840262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.841751 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.856291 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1364/2760] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:18.870487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:18.872999 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7da8f9-4f95-4d23-9f6e-61b91e38abf6 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:18.893116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1397/2761] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:24.370391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:24.386058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091dec8-3298-4f24-8802-6683758268fe service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:24.392290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:24.393430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:24.393918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:24.394370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:24.407451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:24.409411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:24.424930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1365/2762] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:28.125262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f72e-5b7f-4389-912e-474f769e4fa4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.126178 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f72e-5b7f-4389-912e-474f769e4fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.126767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f72e-5b7f-4389-912e-474f769e4fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.167429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-05c7f72e-5b7f-4389-912e-474f769e4fa4 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:28.169745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-05c7f72e-5b7f-4389-912e-474f769e4fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.267749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1398/2763] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:28.354084 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:28.356073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:28.464451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7755bd-d281-4317-91fa-cfd5a52ca166 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:28.470801 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:28.472031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:28.472415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:28.472736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:28.478534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:28.482716 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:28.484866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:28.499445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1366/2764] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:22:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:22:29.579512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122832f-b224-44da-84c2-fc8c995e82a5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.580586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122832f-b224-44da-84c2-fc8c995e82a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.580853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122832f-b224-44da-84c2-fc8c995e82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.625201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e122832f-b224-44da-84c2-fc8c995e82a5 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:29.627589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e122832f-b224-44da-84c2-fc8c995e82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:29.649205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1399/2765] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:22:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:29.665792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:29.687831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759d932-c2dd-4dae-9664-5aec31cef4b2 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:29.706630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:29.708211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:29.708984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:29.710640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:29.729979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:29.733533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:29.765413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1367/2766] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:22:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:22:30.184681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.185005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.185280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.209325 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:30.210590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.218482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1400/2767] 10.222.0.61 () {58 vars in 1009 bytes} [Mon Aug 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:30.234176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.266347 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96aadc-b0ae-476e-8b49-72cd372ae6e6 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.288098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.289065 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.289750 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.291140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.297080 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.314004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.317301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56932b0a-ae57-4bcf-992a-2516fb22c2d4 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.326239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa0fab-e5b8-4008-8ff8-a47eaf46ff44 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.338043 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.339480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.339642 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1368/2768] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:22:30.339834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.340115 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] PATH_INFO: `/v3/users/39902b0db93446579f88aee90810ae69` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.341520 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39902b0db93446579f88aee90810ae69)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.343721 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.413588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:30.427490 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39902b0db93446579f88aee90810ae69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.429047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39902b0db93446579f88aee90810ae69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.444458 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39902b0db93446579f88aee90810ae69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.463007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39902b0db93446579f88aee90810ae69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.464294 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39902b0db93446579f88aee90810ae69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.502266 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1401/2769] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:30 2022] DELETE /identity/v3/users/39902b0db93446579f88aee90810ae69 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:30.505328 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.505908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.506744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.546810 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.548817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:30.549090 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.551827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.711997 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1369/2770] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:30.727413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:30.730910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:30.830386 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdfbc3-e31d-4ff7-94d0-26be2b649be7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.839377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.840044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.840321 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.840588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] PATH_INFO: `/v3/users/901e51998a164fa684f7532dae5fb240` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.845201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=901e51998a164fa684f7532dae5fb240)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.847836 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.862893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622043fb-ed17-4bf4-96e4-90e9b5e6a4b2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:30.884088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:30.885201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:30.885765 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:30.886482 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:30.911469 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:30.919212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1552055-b589-4729-99d0-a3ac4977aba3 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:30.942419 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1370/2771] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:30.942886 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901e51998a164fa684f7532dae5fb240'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.943828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901e51998a164fa684f7532dae5fb240'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.953622 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901e51998a164fa684f7532dae5fb240'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.973236 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901e51998a164fa684f7532dae5fb240'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:30.973902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901e51998a164fa684f7532dae5fb240'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.019840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1402/2772] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:30 2022] DELETE /identity/v3/users/901e51998a164fa684f7532dae5fb240 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:31.067372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.067778 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.068094 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.091779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] MFA Rules not processed for user `8618c519c27c404db3205746c53f58b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:31.093418 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.183867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1371/2773] 10.222.0.61 () {58 vars in 967 bytes} [Mon Aug 29 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:31.207457 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.209986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.318332 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.366484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532fe70-a98d-47bf-bd1e-9d5aa2a7f38a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.375635 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '746f454bf6df48378388ac7372961998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.376716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.378366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.378366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.396830 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.400388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.417067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1403/2774] 10.222.0.61 () {60 vars in 1384 bytes} [Mon Aug 29 20:22:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 20:22:31.453262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.455529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.525650 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:31.652793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ffde7-5005-40b7-a2ee-f79776eeb2e6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.666928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.667976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.668721 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.669583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] PATH_INFO: `/v3/projects/b7585d9478834cedb03c61e4d8b630b0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.672349 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7585d9478834cedb03c61e4d8b630b0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.677950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:31.755489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.758035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.795774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4450-3536-4c29-9cb4-80a8edd00ced service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:31.818108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7585d9478834cedb03c61e4d8b630b0', 'request_id': 'req-93d2c77a-ad77-4452-b6cc-2ad171705354'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.838636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7585d9478834cedb03c61e4d8b630b0', 'request_id': 'req-93d2c77a-ad77-4452-b6cc-2ad171705354'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.854931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7585d9478834cedb03c61e4d8b630b0', 'request_id': 'req-93d2c77a-ad77-4452-b6cc-2ad171705354'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.907204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] The token cache is being invalidate because project b7585d9478834cedb03c61e4d8b630b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:31.907709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.909369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:31.913724 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1372/2775] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:31 2022] DELETE /identity/v3/projects/b7585d9478834cedb03c61e4d8b630b0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:31.920473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:31.922858 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:31.973366 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:31.977872 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:31.978382 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:31.978845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] PATH_INFO: `/v3/projects/3faeb4e2f06d4d2d811264955478547e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:31.981652 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3faeb4e2f06d4d2d811264955478547e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:31.985233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.103049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c77a-ad77-4452-b6cc-2ad171705354 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.121169 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faeb4e2f06d4d2d811264955478547e', 'request_id': 'req-34c38ac3-6b13-4aba-8872-9db290199064'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.136479 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faeb4e2f06d4d2d811264955478547e', 'request_id': 'req-34c38ac3-6b13-4aba-8872-9db290199064'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.149172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faeb4e2f06d4d2d811264955478547e', 'request_id': 'req-34c38ac3-6b13-4aba-8872-9db290199064'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.181206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] The token cache is being invalidate because project 3faeb4e2f06d4d2d811264955478547e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:32.182312 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.185359 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.191716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1404/2776] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:31 2022] DELETE /identity/v3/projects/3faeb4e2f06d4d2d811264955478547e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:32.193905 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.198003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:32.222811 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:32.247877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.248632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.249049 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.249322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] PATH_INFO: `/v3/users/4be322576b7b4f02bcbc93638893c05b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.259529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be322576b7b4f02bcbc93638893c05b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.262214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.363146 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:32.382567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38ac3-6b13-4aba-8872-9db290199064 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:32.399743 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:32.400029 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be322576b7b4f02bcbc93638893c05b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.401040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:32.401660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:32.402144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] PATH_INFO: `/v3/users/b655dd3caed4403a8850abd3ed11ed2c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:32.403980 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b655dd3caed4403a8850abd3ed11ed2c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:32.407803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:32.424691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be322576b7b4f02bcbc93638893c05b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.474725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be322576b7b4f02bcbc93638893c05b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.478131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be322576b7b4f02bcbc93638893c05b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.479076 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be322576b7b4f02bcbc93638893c05b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.529999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1373/2777] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:31 2022] DELETE /identity/v3/users/4be322576b7b4f02bcbc93638893c05b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:32.547626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b655dd3caed4403a8850abd3ed11ed2c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.548212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b655dd3caed4403a8850abd3ed11ed2c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.568042 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b655dd3caed4403a8850abd3ed11ed2c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.594852 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b655dd3caed4403a8850abd3ed11ed2c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.595786 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b655dd3caed4403a8850abd3ed11ed2c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:32.640901 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1405/2778] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:32 2022] DELETE /identity/v3/users/b655dd3caed4403a8850abd3ed11ed2c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:32.988473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:32.991975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:33.102370 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56487f5a-685f-4409-9eec-264521fda117 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.194404 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.195689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.195971 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.196354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] PATH_INFO: `/v3/projects/cbe17980d60b463dae972bb6d314b38f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.198832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe17980d60b463dae972bb6d314b38f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.203155 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.251113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:33.317299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe17980d60b463dae972bb6d314b38f', 'request_id': 'req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.377736 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe17980d60b463dae972bb6d314b38f', 'request_id': 'req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.404851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe17980d60b463dae972bb6d314b38f', 'request_id': 'req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.440701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] The token cache is being invalidate because project cbe17980d60b463dae972bb6d314b38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:33.441534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.445565 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-15720ab5-4a4e-40c3-8bb1-2dfaac3595b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.447702 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1374/2779] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:32 2022] DELETE /identity/v3/projects/cbe17980d60b463dae972bb6d314b38f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:33.695154 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:33.697463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:33.717272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101e289-6190-4114-b684-5998b77310e7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:33.867286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:33.868423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:33.868738 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:33.869044 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] PATH_INFO: `/v3/projects/53ccfef2bc274c26a3a127f830a06077` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:33.870644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ccfef2bc274c26a3a127f830a06077)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:33.873047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:33.966965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ccfef2bc274c26a3a127f830a06077', 'request_id': 'req-103fffcc-b1db-438c-8d24-7b62da5fd841'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.982634 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ccfef2bc274c26a3a127f830a06077', 'request_id': 'req-103fffcc-b1db-438c-8d24-7b62da5fd841'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:33.993688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ccfef2bc274c26a3a127f830a06077', 'request_id': 'req-103fffcc-b1db-438c-8d24-7b62da5fd841'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.011526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] The token cache is being invalidate because project 53ccfef2bc274c26a3a127f830a06077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:34.011526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.012263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103fffcc-b1db-438c-8d24-7b62da5fd841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.014242 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1406/2780] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:33 2022] DELETE /identity/v3/projects/53ccfef2bc274c26a3a127f830a06077 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:34.021871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.022439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.022816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.054664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.056918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.174612 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1375/2781] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:34.187570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.187947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.188343 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.214034 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.224777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.227671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.242437 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1407/2782] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:34.249193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.266553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16216a2-15d9-4f8e-b9b6-74b0ceb6d702 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.274148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.274768 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.275041 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.275308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.275982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:34.276282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.278942 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.300972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1376/2783] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:22:34.307279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.318964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b63385-57a3-42d2-b85b-a57f507eb766 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.325845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.326478 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.326869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.327222 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.327829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.330853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.367775 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1408/2784] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:34.376318 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.388790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f55e8-1502-4470-83d3-ad8ad593e681 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.462270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.464601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.514875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.515562 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.515967 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.516364 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.517332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.520585 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.544063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342a798-f2e1-495f-88c3-daa4505d4aa8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.551891 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.552585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.552892 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.553247 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] PATH_INFO: `/v3/users/22b7ec0cae184bd5b69f87c0976456a4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.554546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b7ec0cae184bd5b69f87c0976456a4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.556776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.559191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1377/2785] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:34.561156 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.580915 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb759-eedd-45a6-b23b-de967f85cfd3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.590854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.591944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.592533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.593055 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.594269 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.598290 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.614772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1378/2786] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:34.619507 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.631839 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6414ee2-510c-4c73-a391-c170ab10e77d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.638195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.638984 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.639365 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.639711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.640428 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.642424 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.644493 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b7ec0cae184bd5b69f87c0976456a4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.645767 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b7ec0cae184bd5b69f87c0976456a4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.654860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1379/2787] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:22:34.657739 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b7ec0cae184bd5b69f87c0976456a4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.668698 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b7ec0cae184bd5b69f87c0976456a4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.670893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fa03292c-1b78-4f78-b116-34f00738ff9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b7ec0cae184bd5b69f87c0976456a4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:34.672652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.675212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.692973 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.700831 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1409/2788] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:34 2022] DELETE /identity/v3/users/22b7ec0cae184bd5b69f87c0976456a4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:34.705288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078fa3d-54f3-4671-8254-bee08581d007 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.707327 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42b00-0c73-4898-8131-b4cd313b8fd5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.707715 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42b00-0c73-4898-8131-b4cd313b8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.708109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b42b00-0c73-4898-8131-b4cd313b8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.730936 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-79b42b00-0c73-4898-8131-b4cd313b8fd5 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.732518 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-79b42b00-0c73-4898-8131-b4cd313b8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.787857 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.788674 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.789004 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.789411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] PATH_INFO: `/v3/projects/3759f46bb0144fdb931874ee2b3587fe/users/b532337e97b04638a6afd7333be9bd9f/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.807728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3759f46bb0144fdb931874ee2b3587fe, user_id=b532337e97b04638a6afd7333be9bd9f, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:34.810937 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:34.817833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:34.830743 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1380/2789] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:34 2022] PUT /identity/v3/projects/3759f46bb0144fdb931874ee2b3587fe/users/b532337e97b04638a6afd7333be9bd9f/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:34.834293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1410/2790] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:34.847263 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:34.849513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.910085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.910353 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.910601 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:34.943793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] MFA Rules not processed for user `b532337e97b04638a6afd7333be9bd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:34.945059 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:34.945647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bf156-beda-4dbe-b0b4-4fb18537e92e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:34.951669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:34.952816 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:34.953538 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:34.954081 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.030592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1411/2791] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:35.042690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.044128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.044315 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.046779 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.055709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1381/2792] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:35.135279 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c3c7-9b68-458f-8feb-8f677bd3e84f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.143679 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.144563 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.144937 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.145148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.159847 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.162069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.174569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1412/2793] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:35.197305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.208701 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73d5c0-b88a-46bf-b16d-b4a9a39ac96f service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.213791 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.214452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.214739 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.215011 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] PATH_INFO: `/v3/users/b532337e97b04638a6afd7333be9bd9f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.216331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b532337e97b04638a6afd7333be9bd9f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.218431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.282412 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:35.308688 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b532337e97b04638a6afd7333be9bd9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.316076 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.318863 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.325872 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b532337e97b04638a6afd7333be9bd9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.341736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa99d-2227-487e-b197-e5ab33f055b7 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.351005 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.352217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.352934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.353531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] PATH_INFO: `/v3/projects/05c41f633e3b4682b93ebe5b55d93509` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.356424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c41f633e3b4682b93ebe5b55d93509)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.359809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b532337e97b04638a6afd7333be9bd9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.360622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b532337e97b04638a6afd7333be9bd9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.361251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.361704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cbfd3b0f-18c2-4cbe-aa52-92d1390c7c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b532337e97b04638a6afd7333be9bd9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.382460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1382/2794] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:35 2022] DELETE /identity/v3/users/b532337e97b04638a6afd7333be9bd9f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:35.387807 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.388233 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.388619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.413032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:35.415047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.451716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c41f633e3b4682b93ebe5b55d93509', 'request_id': 'req-80be035e-0e65-4ec8-a105-fb03984f4a55'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.459868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c41f633e3b4682b93ebe5b55d93509', 'request_id': 'req-80be035e-0e65-4ec8-a105-fb03984f4a55'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.467771 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c41f633e3b4682b93ebe5b55d93509', 'request_id': 'req-80be035e-0e65-4ec8-a105-fb03984f4a55'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.486882 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] The token cache is being invalidate because project 05c41f633e3b4682b93ebe5b55d93509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:35.487322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.488414 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-80be035e-0e65-4ec8-a105-fb03984f4a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:35.490561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1413/2795] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:35 2022] DELETE /identity/v3/projects/05c41f633e3b4682b93ebe5b55d93509 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:35.495781 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7da8-7392-4cd2-acc7-bb31a1beb3bf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.496071 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7da8-7392-4cd2-acc7-bb31a1beb3bf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.496328 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f7da8-7392-4cd2-acc7-bb31a1beb3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.514338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1383/2796] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:35.520482 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3e0f7da8-7392-4cd2-acc7-bb31a1beb3bf None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:35.521737 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3e0f7da8-7392-4cd2-acc7-bb31a1beb3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.524865 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.526877 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.538839 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:35.635457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c63184-a84a-4fd4-b558-fc6c299568d0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.644686 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1414/2797] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:35.657100 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.658188 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.658532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.693110 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:35.695262 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:35.709755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1415/2798] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:35.716428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.728583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.729415 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.729878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.730360 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.730710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53993d-7828-46ed-8eba-e9576f131111 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.742118 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.742790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.743476 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.743903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.744880 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:35.745314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.747436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.747897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.750337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.764438 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1416/2799] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:22:35.771649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.775715 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1384/2800] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:22:35.789600 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9be38-0e53-4284-8684-f6d2fc1adca0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.797693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:35.798745 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:35.799037 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:35.799390 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:35.804979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:35.804979 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:35.856920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1417/2801] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/projects => generated 399 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:35.859549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:35.883521 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c33d4-3d5d-4a5b-ab04-0f699b23d1c1 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:35.898697 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:36.011096 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.012079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.012451 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.012934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.013709 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.016217 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.058995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1385/2802] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:35 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:36.061570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.080939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0be19-f865-4879-b1a2-498dbb0db458 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.089278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.090316 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.090790 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.091256 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.092489 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.096725 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.120906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1418/2803] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:36.127331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.146020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117b641-c0fb-4ab0-b0cd-cf76d8420f55 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.154122 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.155174 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.155686 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.156127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.157339 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.160533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.183572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1386/2804] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:36.188665 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.204150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e426589-6f23-40ff-9516-770f924ee78a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.210439 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.211136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.211407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.211833 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] PATH_INFO: `/v3/projects/b3539f8284854ad7bfef521983a5489f/users/63c012f5962b455aa10018820cebe66f/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.236114 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3539f8284854ad7bfef521983a5489f, user_id=63c012f5962b455aa10018820cebe66f, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.240079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02faad-d022-4b48-a560-e16c73ee3977 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.265711 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.284932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1419/2805] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:36 2022] PUT /identity/v3/projects/b3539f8284854ad7bfef521983a5489f/users/63c012f5962b455aa10018820cebe66f/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:36.285821 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.291388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.291853 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.293774 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.294003 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb85d97-a3e3-4a64-a09c-c5b9be2794d5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.355362 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] MFA Rules not processed for user `63c012f5962b455aa10018820cebe66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:36.357749 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.400175 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.401255 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.401934 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.402088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] PATH_INFO: `/v3/projects/3759f46bb0144fdb931874ee2b3587fe` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.403609 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3759f46bb0144fdb931874ee2b3587fe)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.405820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.482882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3759f46bb0144fdb931874ee2b3587fe', 'request_id': 'req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:36.484481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1420/2806] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:36.494596 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3759f46bb0144fdb931874ee2b3587fe', 'request_id': 'req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:36.499965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.502185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.506573 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3759f46bb0144fdb931874ee2b3587fe', 'request_id': 'req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:36.525135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] The token cache is being invalidate because project 3759f46bb0144fdb931874ee2b3587fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:36.525522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:36.526353 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-77159bd6-6d8e-4c80-bc94-f102ca0a6d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:36.528867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1387/2807] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:36 2022] DELETE /identity/v3/projects/3759f46bb0144fdb931874ee2b3587fe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:36.535372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d52-4122-49fc-b913-ba4de9c2c59e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.535810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d52-4122-49fc-b913-ba4de9c2c59e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.536248 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d52-4122-49fc-b913-ba4de9c2c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.557168 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:36.565758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-aae50d52-4122-49fc-b913-ba4de9c2c59e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:36.567487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-aae50d52-4122-49fc-b913-ba4de9c2c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.587408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:36.617317 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133a31e-fea3-4af8-9b05-7ea37c684e76 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.677372 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1388/2808] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:36.688676 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.689070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.689305 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.710740 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.711399 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.711630 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.711903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.714281 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.718534 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:36.721226 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:36.735066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1389/2809] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:22:36.742212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.760455 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b797d95-c3d9-4c5b-983e-ef664da212e3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.769057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.770072 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.770531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.770995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.772195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:22:36.772773 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.775810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.800924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.807604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1390/2810] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:22:36.808025 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.811792 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.819594 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1421/2811] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:36.826515 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064e18-1a25-4cdb-8902-0cb0e4bc0540 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:36.833238 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:36.833869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:36.834158 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:36.834403 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:36.835058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:36.837619 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:36.895675 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1391/2812] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:22:36 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:22:36.900704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:36.921263 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387456a-2bf6-4e3a-a9d4-ae8ba0dfdc15 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.032590 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.033793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.034260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.034732 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.035932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.039861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.075201 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1422/2813] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:22:36 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:22:37.081413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:37.096559 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abff06-8744-4c4d-a881-7f72c3a8efeb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.103236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.103949 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.104272 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.104717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.105594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.107487 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.125506 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1392/2814] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:37.129747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:37.146167 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d511b-0211-4999-a094-70a9250bc520 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.156231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.157243 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.158131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.158535 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.160193 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.162991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c690d8-4a31-46af-a60c-67fb1b4f6f83 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.181356 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1423/2815] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:22:37.187806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:37.209632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653138bf-19d2-4917-b0cf-7af2a4cb97aa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.218310 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.219558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.220135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.221247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] PATH_INFO: `/v3/projects/e842fe93b98e4bed95078f0afe3ac47e/users/d3cc63e3ba7a40cf827a3fe551e7ab44/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.254493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e842fe93b98e4bed95078f0afe3ac47e, user_id=d3cc63e3ba7a40cf827a3fe551e7ab44, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.260194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.295689 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1393/2816] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:22:37 2022] PUT /identity/v3/projects/e842fe93b98e4bed95078f0afe3ac47e/users/d3cc63e3ba7a40cf827a3fe551e7ab44/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:22:37.317311 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.317654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.318524 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.374796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] MFA Rules not processed for user `d3cc63e3ba7a40cf827a3fe551e7ab44`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:37.377419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:37.384580 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:37.527098 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1424/2817] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:37.551651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:37.553953 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:37.694822 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd4f7-c855-4458-9ffd-48315fa179cc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:37.702027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:37.702781 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:37.703091 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:37.703396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:37.721483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:37.723473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097db5-93bf-4f7c-8746-71eaca2d3667 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:37.734992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1394/2818] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:42.376951 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:42.379313 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.497657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24b6a1-c77f-44eb-8d3c-f87fca51cf76 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:42.502780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:42.503548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.503866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.504176 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] PATH_INFO: `/v3/users/63c012f5962b455aa10018820cebe66f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.505869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c012f5962b455aa10018820cebe66f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:42.508128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:42.592922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c012f5962b455aa10018820cebe66f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.594401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c012f5962b455aa10018820cebe66f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.608348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c012f5962b455aa10018820cebe66f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.621215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c012f5962b455aa10018820cebe66f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.622322 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c012f5962b455aa10018820cebe66f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:42.662657 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1425/2819] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:22:42 2022] DELETE /identity/v3/users/63c012f5962b455aa10018820cebe66f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:42.669317 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.670240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.670240 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.699717 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:22:42.701195 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.763331 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:42.794579 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1395/2820] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:22:42.806527 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:42.808204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:42.865212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:42.924736 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d4210-c5ec-41c9-95ef-23e01af27570 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:42.930006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:42.930730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:42.931054 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:42.931597 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:42.944069 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:42.945591 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:42.958539 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1426/2821] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:22:43.420344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:22:43.422714 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:22:43.450925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01d92b-3b02-4d88-8603-5b09defa06f0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:22:43.466157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:22:43.469228 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:22:43.470925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:22:43.472074 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] PATH_INFO: `/v3/projects/b3539f8284854ad7bfef521983a5489f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:22:43.475941 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3539f8284854ad7bfef521983a5489f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:22:43.484170 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:22:43.583993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3539f8284854ad7bfef521983a5489f', 'request_id': 'req-a5929130-7193-4b0c-8fb0-766effbf77c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:43.592885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3539f8284854ad7bfef521983a5489f', 'request_id': 'req-a5929130-7193-4b0c-8fb0-766effbf77c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:43.604384 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3539f8284854ad7bfef521983a5489f', 'request_id': 'req-a5929130-7193-4b0c-8fb0-766effbf77c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:43.625121 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] The token cache is being invalidate because project b3539f8284854ad7bfef521983a5489f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:22:43.625578 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:43.627042 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5929130-7193-4b0c-8fb0-766effbf77c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:22:43.629085 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1396/2822] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:22:43 2022] DELETE /identity/v3/projects/b3539f8284854ad7bfef521983a5489f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:22:52.952481 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=15 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:22:53.620517 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:11.121722 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.124265 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.151615 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56700-5cc3-463e-8abc-7dea2b9743d9 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.266119 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.266973 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.267291 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.267685 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] PATH_INFO: `/v3/users/d3cc63e3ba7a40cf827a3fe551e7ab44` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.269588 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cc63e3ba7a40cf827a3fe551e7ab44)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.272180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.339819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cc63e3ba7a40cf827a3fe551e7ab44'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.340834 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cc63e3ba7a40cf827a3fe551e7ab44'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.353820 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cc63e3ba7a40cf827a3fe551e7ab44'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.370377 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cc63e3ba7a40cf827a3fe551e7ab44'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.372917 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cc63e3ba7a40cf827a3fe551e7ab44'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:11.412286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1427/2823] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:23:11 2022] DELETE /identity/v3/users/d3cc63e3ba7a40cf827a3fe551e7ab44 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:11.419924 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.420882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.420882 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.450194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:11.452423 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.561176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1397/2824] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:23:11.575769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:11.577734 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:11.673385 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f040-c6ee-4f1f-874f-7dd4a157fdeb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:11.681894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:11.683008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:11.683595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:11.684212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:11.700402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:11.702213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d1c04-3542-4ff7-8940-044dde7166e3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:11.720085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1428/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:23:12.554561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:23:12.556779 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:12.577463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca7601-ad4d-47e7-98d0-3acb29877022 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:23:12.604630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:23:12.605588 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:12.606400 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:12.606808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] PATH_INFO: `/v3/projects/e842fe93b98e4bed95078f0afe3ac47e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:12.608920 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e842fe93b98e4bed95078f0afe3ac47e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:23:12.614015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:23:12.733944 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e842fe93b98e4bed95078f0afe3ac47e', 'request_id': 'req-8af28803-b11b-479a-9da0-f7902d62280f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.748589 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e842fe93b98e4bed95078f0afe3ac47e', 'request_id': 'req-8af28803-b11b-479a-9da0-f7902d62280f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.759704 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e842fe93b98e4bed95078f0afe3ac47e', 'request_id': 'req-8af28803-b11b-479a-9da0-f7902d62280f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.783391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] The token cache is being invalidate because project e842fe93b98e4bed95078f0afe3ac47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:23:12.783855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.785016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:23:12.787730 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1398/2826] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:23:12 2022] DELETE /identity/v3/projects/e842fe93b98e4bed95078f0afe3ac47e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:23:17.065411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:23:17.066304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:23:17.066304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:23:17.088123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] MFA Rules not processed for user `5baeae00a21f4b26b7ede28c998b31bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:23:17.089383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:23:17.115924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:17.176094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1429/2827] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:23:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:23:22.777809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:23:27.167299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=15 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:10.217522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:10.219601 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:10.308472 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af28803-b11b-479a-9da0-f7902d62280f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:10.314955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:10.315617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:10.315931 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:10.316208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:10.318345 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:10.450040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:10.451670 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:10.470780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1399/2828] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:13.386538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:13.388977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.480710 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621bfe-93a0-4284-bbfb-a3ae70492ca2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:13.485406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:13.486239 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:13.486624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:13.487002 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:13.489117 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:13.505760 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:13.507220 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:13.521777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1430/2829] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:20.459551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=54 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:23.514428 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=26 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:26.514896 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:26.520234 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:26.646157 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f748c6-2766-48af-8f71-0a7ff42f65e2 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:26.651777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:26.652463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:26.652893 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:26.653193 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] PATH_INFO: `/v3/users/5baeae00a21f4b26b7ede28c998b31bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:26.654690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baeae00a21f4b26b7ede28c998b31bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:26.658510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:26.723128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baeae00a21f4b26b7ede28c998b31bb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:26.731387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baeae00a21f4b26b7ede28c998b31bb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:26.747019 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baeae00a21f4b26b7ede28c998b31bb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:26.747897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baeae00a21f4b26b7ede28c998b31bb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:26.748829 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-cf595f61-fcbc-4cf2-bdae-657fe45925b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baeae00a21f4b26b7ede28c998b31bb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:26.764810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1400/2830] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:26 2022] DELETE /identity/v3/users/5baeae00a21f4b26b7ede28c998b31bb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:26.987426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.000185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d83db-6470-46dc-a63f-ce524a9b9f1d service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.072664 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.073318 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.073585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.073849 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] PATH_INFO: `/v3/projects/d489f6978f24455c98da42932e4c2f6e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.075027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d489f6978f24455c98da42932e4c2f6e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.077006 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.140440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd489f6978f24455c98da42932e4c2f6e', 'request_id': 'req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:27.150278 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd489f6978f24455c98da42932e4c2f6e', 'request_id': 'req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:27.158809 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd489f6978f24455c98da42932e4c2f6e', 'request_id': 'req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:27.176654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] The token cache is being invalidate because project d489f6978f24455c98da42932e4c2f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:27.176947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:27.177614 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-18d8ce5d-e1e3-47e4-b31c-5ac200816af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:27.179248 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1431/2831] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:26 2022] DELETE /identity/v3/projects/d489f6978f24455c98da42932e4c2f6e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:27.187037 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.188173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.188173 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.214597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:27.215897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:27.294119 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1401/2832] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:27.302869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.303140 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.303394 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.325123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:27.326427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:27.336877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1432/2833] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:27.341673 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.353658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984cf00-207f-4e43-82b2-4561ef0a4812 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.358758 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.359649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.359854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.360073 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.360863 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:27.361164 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.362814 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.376514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1402/2834] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:24:27.381564 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.398912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d04af-4d71-450e-aab8-a531277741ac None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.406487 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.407545 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.408056 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.408548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.409818 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.413557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.453337 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1433/2835] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:27.457744 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.470097 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bd980-1d19-49d8-a6dd-d2235c8520e7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.474649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:27.540737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.541508 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.541616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.541897 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.542553 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.544493 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.576351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1403/2836] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:27.581963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.599172 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e1af-2419-4902-9766-14b7da53a253 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.606671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.607324 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.607595 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.607861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.608526 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.610876 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.623112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1434/2837] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:27.628514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.640176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09908-a129-4905-a6f9-4d31d813ad8b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.645943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.646725 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.647000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.647956 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.649655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.653144 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8ece5-6b35-48b5-bb3f-e5221d674e9e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.677278 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1404/2838] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:27.682404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.697183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53e060-ea85-4810-b011-83bd26b36637 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:27.706435 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:27.707419 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.707777 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.708213 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] PATH_INFO: `/v3/projects/fd79bc733396405dad79ad56745ef83a/users/f98aede67dd047cab30bbae458a0a575/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.741156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd79bc733396405dad79ad56745ef83a, user_id=f98aede67dd047cab30bbae458a0a575, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:27.744063 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:27.761673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1435/2839] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:27 2022] PUT /identity/v3/projects/fd79bc733396405dad79ad56745ef83a/users/f98aede67dd047cab30bbae458a0a575/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:27.774886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:27.775165 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:27.775438 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:27.809221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] MFA Rules not processed for user `f98aede67dd047cab30bbae458a0a575`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:27.810652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:27.905243 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1405/2840] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:27.916986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:27.967984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:28.025207 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee84cbc-a713-4e7a-ae1f-319a330d554e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.033938 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.034956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.035429 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.035889 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.037081 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.040869 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.095579 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1436/2841] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:27 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:28.101346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.115420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375194ca-62a7-44f0-86b3-ca8179362f30 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.199855 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.200480 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.200772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.201057 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.201698 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.203845 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.231899 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1406/2842] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:28 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:28.238908 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.253531 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad33b29-fdbe-4856-b1a0-144582346a8b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.258958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.259586 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.260083 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.260226 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.260800 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.262441 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.278246 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1437/2843] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:28.284140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.291880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:28.298323 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed485-8f03-48d9-95ae-cb0dc0842caf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.307426 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.309599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.309599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.309599 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] PATH_INFO: `/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9/users/c202bae9340d4cfa979f510af4c25d34/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.331056 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538dd1e5f6d44bf1a22940f03f5d22a9, user_id=c202bae9340d4cfa979f510af4c25d34, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.334280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.352212 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1407/2844] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:28 2022] PUT /identity/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9/users/c202bae9340d4cfa979f510af4c25d34/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:28.357522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.370298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7291-8563-4f91-9224-3f3f73240c11 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.460341 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.461008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.461349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.461544 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.462204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.463956 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce642cb-02fb-46cf-b2d5-1b26c71ae089 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.476992 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1438/2845] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:28.482214 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.501976 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba55ed-e560-4dc2-af94-c8ceac0bdba3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.510495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.511598 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.512061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.512523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] PATH_INFO: `/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9/users/c202bae9340d4cfa979f510af4c25d34/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.516687 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=538dd1e5f6d44bf1a22940f03f5d22a9, user_id=c202bae9340d4cfa979f510af4c25d34, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.522110 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.543652 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1408/2846] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:28 2022] PUT /identity/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9/users/c202bae9340d4cfa979f510af4c25d34/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:28.561577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.561950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.562206 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.600893 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] MFA Rules not processed for user `c202bae9340d4cfa979f510af4c25d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:28.602238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:28.722087 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1439/2847] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:28.742209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.744533 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:28.823583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e8d6-fe1c-41a2-aeb2-5f551c7843ff admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.829213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.829607 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.829938 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.830211 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.843299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:28.845463 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:28.860452 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1409/2848] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:28.949469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:28.963569 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d05eb-6b2e-4596-b734-12a1db67a66d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:28.968319 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:28.969626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:28.969974 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:28.970351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:28.998987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:29.048474 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:29.049994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adea11f-6ad8-4b55-b799-419ebf9f733c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:29.060423 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1440/2849] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:35.470371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:35.553655 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de467-cb55-41af-a0cc-5fc640c1e5b1 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:35.559684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:35.560827 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:35.561321 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:35.562298 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] PATH_INFO: `/v3/users/f98aede67dd047cab30bbae458a0a575` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:35.563658 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98aede67dd047cab30bbae458a0a575)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:35.566079 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:35.644523 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98aede67dd047cab30bbae458a0a575'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:35.652737 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98aede67dd047cab30bbae458a0a575'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:35.667001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:35.668531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98aede67dd047cab30bbae458a0a575'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:35.669439 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98aede67dd047cab30bbae458a0a575'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:35.670411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98aede67dd047cab30bbae458a0a575'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:35.692617 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1410/2850] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:35 2022] DELETE /identity/v3/users/f98aede67dd047cab30bbae458a0a575 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:35.700877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:35.701670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:35.701868 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:35.727292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:35.727292 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:35.810141 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1441/2851] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:35.825879 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:35.827483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:35.932089 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a207710-7b83-4b6e-888c-979a21a03d3c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:35.936354 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:35.937244 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:35.937532 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:35.937838 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:35.949012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:35.950635 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:35.964148 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1411/2852] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 20:24:36.393007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:36.395403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:36.416842 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe572fc-ce27-42db-a958-f3b769fbce54 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:36.426238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:36.427391 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:36.427888 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:36.428388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] PATH_INFO: `/v3/projects/fd79bc733396405dad79ad56745ef83a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:36.430691 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd79bc733396405dad79ad56745ef83a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:36.434270 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:36.519922 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd79bc733396405dad79ad56745ef83a', 'request_id': 'req-3c31ce3a-66a7-4d34-837f-0756037c290e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.530873 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd79bc733396405dad79ad56745ef83a', 'request_id': 'req-3c31ce3a-66a7-4d34-837f-0756037c290e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.542393 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd79bc733396405dad79ad56745ef83a', 'request_id': 'req-3c31ce3a-66a7-4d34-837f-0756037c290e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.563286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] The token cache is being invalidate because project fd79bc733396405dad79ad56745ef83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:36.563776 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.564928 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.567468 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1442/2853] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:36 2022] DELETE /identity/v3/projects/fd79bc733396405dad79ad56745ef83a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:36.574077 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:36.595040 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40a7e1-1163-4ab1-bae0-792068ffeb6b service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:36.694034 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:36.694752 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:36.695047 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:36.695316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] PATH_INFO: `/v3/users/c202bae9340d4cfa979f510af4c25d34` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:36.696495 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c202bae9340d4cfa979f510af4c25d34)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:36.698492 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:36.747574 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c202bae9340d4cfa979f510af4c25d34'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.759605 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c202bae9340d4cfa979f510af4c25d34'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.772999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c202bae9340d4cfa979f510af4c25d34'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.773713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c202bae9340d4cfa979f510af4c25d34'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.774322 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f07e3eec-faca-40e9-9e69-9f8b15284a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c202bae9340d4cfa979f510af4c25d34'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:36.788930 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1412/2854] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:36 2022] DELETE /identity/v3/users/c202bae9340d4cfa979f510af4c25d34 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:37.107508 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.109216 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:37.124575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31ce3a-66a7-4d34-837f-0756037c290e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.191894 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:37.209659 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.210245 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.210521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.210823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] PATH_INFO: `/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.211995 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538dd1e5f6d44bf1a22940f03f5d22a9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.213958 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.264295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538dd1e5f6d44bf1a22940f03f5d22a9', 'request_id': 'req-b783db2c-6ffe-4108-99d9-4e208605d2b4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:37.270644 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538dd1e5f6d44bf1a22940f03f5d22a9', 'request_id': 'req-b783db2c-6ffe-4108-99d9-4e208605d2b4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:37.276373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538dd1e5f6d44bf1a22940f03f5d22a9', 'request_id': 'req-b783db2c-6ffe-4108-99d9-4e208605d2b4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:37.290717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] The token cache is being invalidate because project 538dd1e5f6d44bf1a22940f03f5d22a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:37.290998 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:37.291755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b783db2c-6ffe-4108-99d9-4e208605d2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:37.293299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1443/2855] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:37 2022] DELETE /identity/v3/projects/538dd1e5f6d44bf1a22940f03f5d22a9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:37.300060 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.300344 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.300640 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.322756 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:37.323894 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:37.329793 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:37.396140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1413/2856] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:37.404519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.404964 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.405381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.426400 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:37.427712 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:37.436212 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1444/2857] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:37.441641 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.452966 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ed5a-ae4b-4633-a363-16b0c5938cac None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.458172 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.459010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.459371 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.459777 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.460671 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:37.461108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.463213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.480636 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1414/2858] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:37.486368 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.497453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583aeb0-8982-4660-838b-45e79c40ff35 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.503144 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.503769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.504035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.504304 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.504972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.506879 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.545215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1445/2859] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:37.550222 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.561012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a155113-8940-497a-b4df-f1d617ccb5d9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.652780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.653583 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.653740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.653939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.654577 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.656918 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.692063 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1415/2860] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:37.693424 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.704957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac6f6-ecef-44a2-9c89-70300982232e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.710427 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.711024 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.711338 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.711645 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.712364 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.714109 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.726388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1446/2861] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:37.732286 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.748800 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd548c-0a25-442e-9745-040ad2b6009c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.754316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.754939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.755247 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.755539 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.756191 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.757851 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd6fc-bca0-4233-a3bf-f997cb6e3b05 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.770051 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1416/2862] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:37.775981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:37.788348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c339f0-b797-4650-8ce4-dbfe3d6b042a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:37.793426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:37.794251 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.794582 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.794897 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] PATH_INFO: `/v3/projects/004d64461ba84ecf8031510f4b92f4a7/users/2a0e92b0944c4f2eb6d286ca5d0ea938/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.813453 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004d64461ba84ecf8031510f4b92f4a7, user_id=2a0e92b0944c4f2eb6d286ca5d0ea938, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:37.818007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:37.835050 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1447/2863] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:37 2022] PUT /identity/v3/projects/004d64461ba84ecf8031510f4b92f4a7/users/2a0e92b0944c4f2eb6d286ca5d0ea938/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:37.852461 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:37.852935 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:37.853266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:37.885465 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] MFA Rules not processed for user `2a0e92b0944c4f2eb6d286ca5d0ea938`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:37.886708 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:37.980818 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1417/2864] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:37.985727 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.055260 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e87d-b2d2-4006-9551-eb6bc7b1e775 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.060027 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.060638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.060939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.061204 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.061934 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.063991 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.080926 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:38.101286 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1448/2865] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:37 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:38.105301 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.116632 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4e489-8a13-47a8-b115-f3d80a571791 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.120936 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:38.181594 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.182209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.182485 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.182759 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.183430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.185389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.215471 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1418/2866] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:38 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:38.221215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.235939 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d2ef0-74d3-496e-9562-f543d0a34176 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.241450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.242070 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.242344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.242605 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.243253 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.244903 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.257339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1449/2867] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:38.261630 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.273510 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000600-e3cd-4806-b1d6-f69f6a3f2608 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.278280 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.278955 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.279235 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.279504 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] PATH_INFO: `/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455/users/771182403a4b4fae8369d3d6434545ee/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.296885 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1e3fa4c6a242ec8472d72cc7f12455, user_id=771182403a4b4fae8369d3d6434545ee, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.299880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.317160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1419/2868] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:38 2022] PUT /identity/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455/users/771182403a4b4fae8369d3d6434545ee/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:38.321803 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.334525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b9f3f-4f74-4d9c-bf16-a5a7feeb394c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.440450 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.441506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.441986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.442469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.443618 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.446553 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debb6e-fa18-4774-8d16-62b7be9871b1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.460011 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1450/2869] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:38.465236 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.477108 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b0f46-5332-4730-9a40-a8410bfa056b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.482266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.482943 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.483221 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.483497 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] PATH_INFO: `/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455/users/771182403a4b4fae8369d3d6434545ee/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.487225 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1e3fa4c6a242ec8472d72cc7f12455, user_id=771182403a4b4fae8369d3d6434545ee, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.489887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.501189 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1420/2870] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:38 2022] PUT /identity/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455/users/771182403a4b4fae8369d3d6434545ee/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:38.511646 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.511963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.512235 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.546209 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] MFA Rules not processed for user `771182403a4b4fae8369d3d6434545ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:38.548986 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:38.626996 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1451/2871] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:38.641113 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.643388 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:38.708460 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ef80-4c44-47a1-8399-05d4a17fc570 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.712462 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.713106 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.713401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.713669 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.725790 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.728039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6bc31-e124-4477-a301-b69f167d8668 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.740604 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1421/2872] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:38.771170 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:38.840791 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c282568-56e4-4c92-b79e-f86a9e2da510 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:38.846484 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:38.847132 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.847407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.847677 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] PATH_INFO: `/v3/users/2a0e92b0944c4f2eb6d286ca5d0ea938` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.848912 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0e92b0944c4f2eb6d286ca5d0ea938)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:38.850848 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:38.857128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:38.907392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0e92b0944c4f2eb6d286ca5d0ea938'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:38.908084 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0e92b0944c4f2eb6d286ca5d0ea938'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:38.915754 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0e92b0944c4f2eb6d286ca5d0ea938'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:38.929567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0e92b0944c4f2eb6d286ca5d0ea938'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:38.930194 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0e92b0944c4f2eb6d286ca5d0ea938'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:38.958058 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1452/2873] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:38 2022] DELETE /identity/v3/users/2a0e92b0944c4f2eb6d286ca5d0ea938 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:38.963722 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:38.964010 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:38.964282 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:38.988143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:38.989408 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:39.084447 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1422/2874] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:39.096924 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:39.098609 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:39.173638 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530fa2f-29e1-46db-ba13-b923c8b3c18f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:39.178238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:39.178933 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:39.179210 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:39.179480 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:39.190765 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:39.192231 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:39.203099 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1453/2875] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:39.517603 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:39.519947 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:39.533151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:39.540284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b9c1c-d798-4dbb-8ef2-8beecb0ca43d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:39.548634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:39.549706 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:39.550250 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:39.551549 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] PATH_INFO: `/v3/projects/004d64461ba84ecf8031510f4b92f4a7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:39.553481 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=004d64461ba84ecf8031510f4b92f4a7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:39.556614 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:39.622520 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004d64461ba84ecf8031510f4b92f4a7', 'request_id': 'req-668e8703-04ca-4ad0-90dd-7ce392d1e87f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.630386 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004d64461ba84ecf8031510f4b92f4a7', 'request_id': 'req-668e8703-04ca-4ad0-90dd-7ce392d1e87f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.638337 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004d64461ba84ecf8031510f4b92f4a7', 'request_id': 'req-668e8703-04ca-4ad0-90dd-7ce392d1e87f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.653881 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] The token cache is being invalidate because project 004d64461ba84ecf8031510f4b92f4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:39.654249 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.654948 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.656945 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1423/2876] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:39 2022] DELETE /identity/v3/projects/004d64461ba84ecf8031510f4b92f4a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:39.662952 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:39.673784 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb5d75-e500-4f10-b13f-8e1646f42775 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:39.739741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:39.740407 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:39.740819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:39.741138 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] PATH_INFO: `/v3/users/771182403a4b4fae8369d3d6434545ee` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:39.744156 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=771182403a4b4fae8369d3d6434545ee)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:39.746127 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:39.782150 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:39.799567 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771182403a4b4fae8369d3d6434545ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.800335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771182403a4b4fae8369d3d6434545ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.813240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771182403a4b4fae8369d3d6434545ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.822649 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771182403a4b4fae8369d3d6434545ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.823303 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-53a04c31-e09c-4efb-b572-bb273e94a4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771182403a4b4fae8369d3d6434545ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:39.843008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1454/2877] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:39 2022] DELETE /identity/v3/users/771182403a4b4fae8369d3d6434545ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:40.153921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.155664 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.171961 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8703-04ca-4ad0-90dd-7ce392d1e87f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.256284 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.257288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.257754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.258213 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] PATH_INFO: `/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.260101 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1e3fa4c6a242ec8472d72cc7f12455)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.263692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.314312 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1e3fa4c6a242ec8472d72cc7f12455', 'request_id': 'req-57edc7e5-5289-44ef-81b4-867eb5d9e796'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:40.321616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1e3fa4c6a242ec8472d72cc7f12455', 'request_id': 'req-57edc7e5-5289-44ef-81b4-867eb5d9e796'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:40.328391 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1e3fa4c6a242ec8472d72cc7f12455', 'request_id': 'req-57edc7e5-5289-44ef-81b4-867eb5d9e796'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:40.342900 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] The token cache is being invalidate because project cc1e3fa4c6a242ec8472d72cc7f12455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:40.343346 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:40.344299 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-57edc7e5-5289-44ef-81b4-867eb5d9e796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:40.345928 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1424/2878] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:40 2022] DELETE /identity/v3/projects/cc1e3fa4c6a242ec8472d72cc7f12455 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:40.351126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.351411 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.351703 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.376485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:40.377769 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.441387 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1455/2879] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:40.449413 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.449705 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.449972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.471871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:40.473127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:40.481420 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1425/2880] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:40.486189 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.496079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7feed-cdea-456b-b3b3-70bcff59c6f8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.506763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.507330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.507621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.508546 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.509305 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:40.509610 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.511218 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.524516 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1456/2881] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:40.529088 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.545529 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ce8e1-1a67-4870-b987-5ef9ad857123 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.553142 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.553833 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.554107 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.554374 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.555032 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.557018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.563401 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:40.594561 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1426/2882] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:40.600452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.612180 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bde09-2cac-4a26-a1eb-232e34445b22 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.675514 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.676179 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.676388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.676643 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.677314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.679233 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.706521 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1457/2883] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 20:24:40.710868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.726197 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edd35d-a365-4b0b-9915-79125c963b32 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.731115 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.731766 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.732039 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.732307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.732995 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.734903 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.746013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1427/2884] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:40.754126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.771003 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883530c-cf5c-4a0f-9cf9-e2e8ddd7c0b9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.775658 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.776267 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.776533 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.776828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.777525 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.779120 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d06b5d-6d15-425f-88df-69d793233b99 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.790828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1458/2885] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:40.795554 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:40.806970 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91047c5-1409-4264-b541-096ce7480fe3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:40.811972 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:40.812728 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.813043 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.813316 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] PATH_INFO: `/v3/projects/93863c6135f54790bedce516258fd406/users/c34b4741b11945adb305b69a7123aabd/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.832729 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93863c6135f54790bedce516258fd406, user_id=c34b4741b11945adb305b69a7123aabd, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:40.837992 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:40.857712 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1428/2886] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:40 2022] PUT /identity/v3/projects/93863c6135f54790bedce516258fd406/users/c34b4741b11945adb305b69a7123aabd/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:40.928344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:40.928673 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:40.928993 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:40.963961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:40.967906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] MFA Rules not processed for user `c34b4741b11945adb305b69a7123aabd`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:40.969670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:41.062351 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1459/2887] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:41.068230 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.164314 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e042e3-45db-4cce-8f3d-b2655f89b97a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.169854 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.170513 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.170795 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.171102 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.171848 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.173850 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.207265 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1429/2888] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:41 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:41.212540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.230729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd390671-2bbf-40e3-9d1d-92715b64d7c7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.318534 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.319392 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.319824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.320272 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.321333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.324730 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.353860 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1460/2889] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:41 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:41.358454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.371662 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6342-c581-4375-afff-d06b4f19e02c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.377379 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.377999 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.378276 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.378546 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.379201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.380860 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.398810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1430/2890] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:41.405568 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.417488 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5572c-94aa-4df2-aa8b-5b12a627e9a1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.424720 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.425719 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.426082 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.426509 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] PATH_INFO: `/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7/users/c8b799e5cbf64ff2b17a861783c323de/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.447502 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] RBAC: Authorizing `identity:create_grant(project_id=106b931e158c4cb2bb0cb2ccc9f953b7, user_id=c8b799e5cbf64ff2b17a861783c323de, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.450227 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.466136 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1461/2891] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:41 2022] PUT /identity/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7/users/c8b799e5cbf64ff2b17a861783c323de/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:41.470774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.482445 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e335ee-38ad-4249-be89-f8dae835ad6c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.543405 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.544015 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.544288 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.544558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.545232 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.547027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0dcd8-2c78-4c40-a52a-b3509b671de8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.557131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1431/2892] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:41.561718 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.572824 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936560e-c32a-425d-a2f3-9ab4700b581b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.578687 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.579813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.579813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.580047 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] PATH_INFO: `/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7/users/c8b799e5cbf64ff2b17a861783c323de/roles/911a5bcd4e504f538aeb3869289f542b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.582001 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=106b931e158c4cb2bb0cb2ccc9f953b7, user_id=c8b799e5cbf64ff2b17a861783c323de, role_id=911a5bcd4e504f538aeb3869289f542b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.584654 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.596421 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1462/2893] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:41 2022] PUT /identity/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7/users/c8b799e5cbf64ff2b17a861783c323de/roles/911a5bcd4e504f538aeb3869289f542b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:41.606871 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.607154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.607430 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.639564 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] MFA Rules not processed for user `c8b799e5cbf64ff2b17a861783c323de`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:41.641457 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:41.651127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:41.717796 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1432/2894] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:41.731557 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:41.734031 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:41.799826 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d0ab-b718-44d1-b914-6ddcd47f6bff admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:41.804877 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:41.805507 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:41.805780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:41.806079 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:41.816183 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:41.817636 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c319a-643a-4c40-938d-17858cd7d3cc service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:41.821947 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:41.829240 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1463/2895] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:42.248499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:42.337382 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7a4f2-0d87-4ae9-aa48-937bc33b402b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:42.346890 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:42.348104 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:42.348741 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:42.349606 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] PATH_INFO: `/v3/users/c34b4741b11945adb305b69a7123aabd` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:42.351259 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34b4741b11945adb305b69a7123aabd)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:42.353308 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:42.433307 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34b4741b11945adb305b69a7123aabd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.441292 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34b4741b11945adb305b69a7123aabd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.455870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34b4741b11945adb305b69a7123aabd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.456880 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34b4741b11945adb305b69a7123aabd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.457623 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34b4741b11945adb305b69a7123aabd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:42.481908 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1433/2896] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:42 2022] DELETE /identity/v3/users/c34b4741b11945adb305b69a7123aabd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:42.487640 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd837-6977-4871-9207-726457827f6f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:42.487923 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd837-6977-4871-9207-726457827f6f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:42.488159 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd837-6977-4871-9207-726457827f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:42.509443 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7e7cd837-6977-4871-9207-726457827f6f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:42.510669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e7cd837-6977-4871-9207-726457827f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:42.589451 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1464/2897] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:42.601325 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:42.602888 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:42.642204 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:42.695103 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5926e8-66db-41da-81ca-84328cd0db8f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:42.698987 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:42.699610 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:42.699886 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:42.700154 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:42.711551 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:42.713112 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:42.724867 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1434/2898] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:43.025404 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cd837-6977-4871-9207-726457827f6f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.027361 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e7cd837-6977-4871-9207-726457827f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.047436 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cd837-6977-4871-9207-726457827f6f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.053314 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.053994 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.054269 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.054522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] PATH_INFO: `/v3/projects/93863c6135f54790bedce516258fd406` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.055716 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93863c6135f54790bedce516258fd406)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.057735 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.129813 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93863c6135f54790bedce516258fd406', 'request_id': 'req-12da22f9-a617-44eb-951d-5da863dcd640'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.137977 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93863c6135f54790bedce516258fd406', 'request_id': 'req-12da22f9-a617-44eb-951d-5da863dcd640'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.144065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93863c6135f54790bedce516258fd406', 'request_id': 'req-12da22f9-a617-44eb-951d-5da863dcd640'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.159463 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] The token cache is being invalidate because project 93863c6135f54790bedce516258fd406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:43.159747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.160381 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.161935 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1465/2899] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:43 2022] DELETE /identity/v3/projects/93863c6135f54790bedce516258fd406 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:43.166127 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.177774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54572793-bdf1-4849-834c-7bc41902aa9c service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.250169 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.251013 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.251178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.251473 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] PATH_INFO: `/v3/users/c8b799e5cbf64ff2b17a861783c323de` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.252651 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b799e5cbf64ff2b17a861783c323de)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.254625 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.312901 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b799e5cbf64ff2b17a861783c323de'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.322959 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b799e5cbf64ff2b17a861783c323de'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.345266 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b799e5cbf64ff2b17a861783c323de'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.346618 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b799e5cbf64ff2b17a861783c323de'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.347616 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-488118d1-b5b6-4cad-ba67-94eb5a3897a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b799e5cbf64ff2b17a861783c323de'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.368840 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1435/2900] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:43 2022] DELETE /identity/v3/users/c8b799e5cbf64ff2b17a861783c323de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:43.745371 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:43.747344 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:43.762360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da22f9-a617-44eb-951d-5da863dcd640 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:43.848538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:43.849388 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.849751 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.850108 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] PATH_INFO: `/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:43.851355 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106b931e158c4cb2bb0cb2ccc9f953b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:43.853333 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:43.894959 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:43.926375 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106b931e158c4cb2bb0cb2ccc9f953b7', 'request_id': 'req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.934838 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106b931e158c4cb2bb0cb2ccc9f953b7', 'request_id': 'req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.943532 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106b931e158c4cb2bb0cb2ccc9f953b7', 'request_id': 'req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.961861 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] The token cache is being invalidate because project 106b931e158c4cb2bb0cb2ccc9f953b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:43.962274 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.963131 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ebb420e-d8a7-47d4-8014-a8d1dd35af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:43.964950 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1466/2901] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:43 2022] DELETE /identity/v3/projects/106b931e158c4cb2bb0cb2ccc9f953b7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:43.971001 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:43.971324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:43.971631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.000143 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:44.001416 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.054660 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:44.073431 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1436/2902] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:44.083793 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.084379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.084379 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.107866 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:44.109205 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.119145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1467/2903] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:44.124868 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.137136 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d4a6-32a9-4e3e-adc9-d431c760cb01 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.142810 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.143483 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.143754 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.144027 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.144678 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:44.145017 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.146713 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.161262 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1437/2904] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:44.165633 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.176512 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe747e7-2eb4-41b8-987a-d2e79572820f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.183092 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.183723 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.184021 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.184280 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.184957 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.187040 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.229035 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1468/2905] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:44.234128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.246151 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fbae-e8d1-41ad-aafa-45d1e58f303a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.307066 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.307878 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.307979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.308201 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.308925 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.311140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.337150 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1438/2906] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:44.341412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.359896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599d0bf-05c1-4b5b-aae7-b32ec44a7668 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.364929 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.365556 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.365829 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.366123 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.366747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.368360 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.380374 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1469/2907] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:44.384950 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.399735 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651507f-b69c-4ae7-a181-bfcc80e41b26 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.406351 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.407134 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.407399 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.407668 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.408335 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.410020 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11901d0a-e6cd-41ba-b3d7-0399ad663cb4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.422804 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1439/2908] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 20:24:44.427185 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.438506 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484253a2-2752-464f-85a8-6e27646c58e7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.443485 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.444148 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.444426 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.444714 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] PATH_INFO: `/v3/projects/dbb2e762b6c540a1b42b0b1967064a2a/users/cc12bd1d5b864732bd91187589698644/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.461271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb2e762b6c540a1b42b0b1967064a2a, user_id=cc12bd1d5b864732bd91187589698644, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.464105 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.478589 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1470/2909] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:44 2022] PUT /identity/v3/projects/dbb2e762b6c540a1b42b0b1967064a2a/users/cc12bd1d5b864732bd91187589698644/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:44.491734 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.492061 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.492336 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.525324 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] MFA Rules not processed for user `cc12bd1d5b864732bd91187589698644`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:44.526643 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.613332 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1440/2910] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:44.624693 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:44.626670 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:44.704215 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302a1d-df1e-4b71-81e8-38d5c8630679 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:44.708577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:44.709217 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:44.709486 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:44.709755 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:44.719536 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:44.721128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd2232-2bda-486a-aaea-1338511c4c62 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:44.731238 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1471/2911] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:48.176326 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.241396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.272030 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0010be7-20c9-4ebd-b441-b741610fca87 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.278194 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.278869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.279141 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.279411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] PATH_INFO: `/v3/users/cc12bd1d5b864732bd91187589698644` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.281661 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc12bd1d5b864732bd91187589698644)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.283843 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:48.340780 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc12bd1d5b864732bd91187589698644'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.349866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc12bd1d5b864732bd91187589698644'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.365180 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc12bd1d5b864732bd91187589698644'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.365986 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc12bd1d5b864732bd91187589698644'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.366622 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc12bd1d5b864732bd91187589698644'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:48.382215 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1441/2912] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:48 2022] DELETE /identity/v3/users/cc12bd1d5b864732bd91187589698644 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:48.387057 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.387681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.387681 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.408454 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:48.409672 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.470373 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:48.496794 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1472/2913] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 20:24:48.508547 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.510806 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.589052 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7262c95-7a89-453a-b49e-e564d3540148 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:48.593958 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:48.594808 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:48.595099 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:48.595442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:48.605921 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:48.607378 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf111e6-2541-4a8b-a9db-3699ef21dc24 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:48.618691 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1442/2914] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:48.978271 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:48.980330 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:48.996349 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfdf9-6f6a-4196-b5ff-7ae22f031c25 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.005548 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.006621 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.007094 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.007562 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] PATH_INFO: `/v3/projects/dbb2e762b6c540a1b42b0b1967064a2a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.009596 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb2e762b6c540a1b42b0b1967064a2a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.013335 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.083165 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb2e762b6c540a1b42b0b1967064a2a', 'request_id': 'req-31967aaa-bfa6-485f-b49e-4edaf654c3c3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.090107 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb2e762b6c540a1b42b0b1967064a2a', 'request_id': 'req-31967aaa-bfa6-485f-b49e-4edaf654c3c3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.097561 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb2e762b6c540a1b42b0b1967064a2a', 'request_id': 'req-31967aaa-bfa6-485f-b49e-4edaf654c3c3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.114310 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] The token cache is being invalidate because project dbb2e762b6c540a1b42b0b1967064a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:49.114660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.115261 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31967aaa-bfa6-485f-b49e-4edaf654c3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:49.116823 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1473/2915] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:48 2022] DELETE /identity/v3/projects/dbb2e762b6c540a1b42b0b1967064a2a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:49.123160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.123453 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.123832 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.147572 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.148849 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.226000 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1443/2916] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.233764 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.234020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.234293 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.258747 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.259961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.268077 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1474/2917] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.272692 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.286910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347d3d-3868-4ba1-a6d4-798e5edc623f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.291979 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.292597 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.292910 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.293182 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.294095 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:49.294229 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.295767 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.298387 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:49.317454 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1444/2918] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 20:24:49.322896 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.336671 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f690e4b-48ac-4058-a771-260c724cc97f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.341626 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.342334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.342684 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.343028 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.344602 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.346577 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.377704 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1475/2919] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:49.382146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.395442 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404e3db-aec9-4e53-9fc5-6ef3ddc58ca3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.488677 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.489258 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.489558 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.489825 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.490512 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.492470 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.516528 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1445/2920] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:49.522549 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.541166 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c6f0e-d94d-4aae-b7de-6ad9b532a55a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.550067 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.550705 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.550984 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.551254 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.551906 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.553608 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.572965 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1476/2921] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:49.578208 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.593045 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b98d5-8893-46bf-b022-d4c31fa7cc57 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.600875 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.601939 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.602411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.602870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.604059 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.606993 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723ddbc-140b-40d8-9549-5e7bb07ac311 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.620160 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1446/2922] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:49.625020 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.636401 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989ddd3-caeb-481c-b132-9857b4b7c1ae admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.641729 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.642403 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.642680 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.642955 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] PATH_INFO: `/v3/projects/4ab3f0e505c946a0a2c20d26b1979662/users/8ba9fa6464264bf3a6ea210ffdf1d12e/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.662807 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab3f0e505c946a0a2c20d26b1979662, user_id=8ba9fa6464264bf3a6ea210ffdf1d12e, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.665519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.684339 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1477/2923] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:49 2022] PUT /identity/v3/projects/4ab3f0e505c946a0a2c20d26b1979662/users/8ba9fa6464264bf3a6ea210ffdf1d12e/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:49.698406 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.698684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.699012 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.732223 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] MFA Rules not processed for user `8ba9fa6464264bf3a6ea210ffdf1d12e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:49.733524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.817270 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1447/2924] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:49.829145 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:49.830913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:49.897051 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb34161-9ac6-4426-8cc4-9d4456912a4b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:49.902819 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:49.903522 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:49.903932 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:49.904164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:49.915383 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:49.916962 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99aa92-0535-4688-9f77-3f92923e912b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:49.927452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1478/2925] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:52.647831 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:52.722114 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b6299-d021-4c68-afd1-25d6da363af8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:52.726742 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:52.727377 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:52.727647 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:52.727913 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] PATH_INFO: `/v3/users/8ba9fa6464264bf3a6ea210ffdf1d12e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:52.729161 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba9fa6464264bf3a6ea210ffdf1d12e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:52.731078 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:52.734352 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:52.788524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba9fa6464264bf3a6ea210ffdf1d12e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:52.796389 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba9fa6464264bf3a6ea210ffdf1d12e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:52.809330 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba9fa6464264bf3a6ea210ffdf1d12e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:52.810080 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba9fa6464264bf3a6ea210ffdf1d12e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:52.810681 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba9fa6464264bf3a6ea210ffdf1d12e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:52.829296 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1448/2926] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:24:52 2022] DELETE /identity/v3/users/8ba9fa6464264bf3a6ea210ffdf1d12e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:52.831299 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:52.831763 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:52.831961 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:52.853241 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:52.854469 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:52.863780 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:52.931348 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1479/2927] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:52.941774 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:52.943273 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.007443 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304381-6502-4c9e-b67b-f34cda388fe2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:53.011385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:53.012018 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.012295 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.012567 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.024870 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:53.027098 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec375d-930c-4989-85c9-8b56f1d8f8c7 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:53.044498 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1449/2928] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:24:53.356402 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:53.359085 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.374126 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca49e-bbc1-4e23-a496-2fc7b8db2a5e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:53.379008 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:53.379592 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.379865 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.380137 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] PATH_INFO: `/v3/projects/4ab3f0e505c946a0a2c20d26b1979662` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.381307 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab3f0e505c946a0a2c20d26b1979662)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:53.383200 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:53.442570 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab3f0e505c946a0a2c20d26b1979662', 'request_id': 'req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:53.451573 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab3f0e505c946a0a2c20d26b1979662', 'request_id': 'req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:53.458910 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab3f0e505c946a0a2c20d26b1979662', 'request_id': 'req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:53.476219 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] The token cache is being invalidate because project 4ab3f0e505c946a0a2c20d26b1979662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:24:53.476660 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:53.477669 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5bc8cce7-5d63-4838-9476-c5278a3d5ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:24:53.479969 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1480/2929] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:24:53 2022] DELETE /identity/v3/projects/4ab3f0e505c946a0a2c20d26b1979662 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:24:53.486631 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.486917 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.487209 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.512343 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:53.513649 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.716477 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1450/2930] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:53.725688 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.725963 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.726229 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.746717 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:53.747972 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:53.758065 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1481/2931] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:53.766977 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:53.777638 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f30ec-5417-4cbe-b96a-4ebdcc4f51e6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:53.783740 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:53.784369 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.784646 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.785016 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.785685 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 20:24:53.785988 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:53.787817 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:53.803690 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1451/2932] 10.222.0.61 () {58 vars in 1153 bytes} [Mon Aug 29 20:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 20:24:53.809164 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:53.821295 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f2f51-ac18-434e-9096-97c05f446812 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:53.827380 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:53.828010 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.828298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.828585 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.829412 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:53.831840 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:53.862741 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1482/2933] 10.222.0.61 () {60 vars in 1153 bytes} [Mon Aug 29 20:24:53 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:53.867338 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:53.878128 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ade16-3108-49c0-87f9-af8635c1a5df admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:53.887279 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:53.952576 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:53.953126 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:53.953396 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:53.953866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:53.960131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:53.960131 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:53.984385 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1452/2934] 10.222.0.61 () {60 vars in 1144 bytes} [Mon Aug 29 20:24:53 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 20:24:53.990925 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:54.005837 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6c0fd-661c-4eb3-aa90-5c4d74507184 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:54.013203 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:54.014116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.015177 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.016116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.016661 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:54.019440 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:54.037255 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1483/2935] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:54.042152 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:54.053499 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03d415-0778-4e3c-9be2-500b71b6d326 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:54.059627 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:54.060242 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.060531 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.060869 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.061569 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:54.063178 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b09bd9-9406-4ccf-a112-25ea13ad0dea admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:54.076070 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1453/2936] 10.222.0.61 () {58 vars in 1122 bytes} [Mon Aug 29 20:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 20:24:54.081812 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:54.092796 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff228e-0a06-47ce-9257-a1cf39b8cc47 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:54.098298 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:54.099007 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.099277 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.099550 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] PATH_INFO: `/v3/projects/17b93a2eb2e54df3ad40403b88f88228/users/a0c12c96e37c4fdf86d136ac3c967cf8/roles/801153a9ae764c76a1e10058e403d371` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.115192 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b93a2eb2e54df3ad40403b88f88228, user_id=a0c12c96e37c4fdf86d136ac3c967cf8, role_id=801153a9ae764c76a1e10058e403d371)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:54.117916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:54.133701 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1484/2937] 10.222.0.61 () {60 vars in 1483 bytes} [Mon Aug 29 20:24:54 2022] PUT /identity/v3/projects/17b93a2eb2e54df3ad40403b88f88228/users/a0c12c96e37c4fdf86d136ac3c967cf8/roles/801153a9ae764c76a1e10058e403d371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 20:24:54.145260 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.145656 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.145952 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.178820 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] MFA Rules not processed for user `a0c12c96e37c4fdf86d136ac3c967cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:24:54.180058 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:54.249809 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1454/2938] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:24:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:24:54.260916 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:24:54.262744 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:24:54.302334 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:24:54.327230 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb42ea-ecde-4291-8eb8-ff7c669bdc23 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:24:54.331976 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa74e5d2adb4da1afcecdb718be98f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:24:54.332603 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:24:54.332913 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:24:54.333187 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:24:54.343128 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:24:54.344920 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa2495-cd4e-4a1b-8b8f-d26ce59f3925 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:24:54.354000 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1485/2939] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:24:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:04.246522 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:04.349967 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=11 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:05.032237 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:05.133975 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24fe9-af7b-4236-aa8d-dab7f4a06a26 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:05.139524 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:05.140176 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.140444 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.140926 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] PATH_INFO: `/v3/users/a0c12c96e37c4fdf86d136ac3c967cf8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.142140 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c12c96e37c4fdf86d136ac3c967cf8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:05.144135 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:05.207543 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c12c96e37c4fdf86d136ac3c967cf8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.215177 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c12c96e37c4fdf86d136ac3c967cf8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.232411 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c12c96e37c4fdf86d136ac3c967cf8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.233887 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c12c96e37c4fdf86d136ac3c967cf8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.235031 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c12c96e37c4fdf86d136ac3c967cf8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.251634 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1455/2940] 10.222.0.61 () {58 vars in 1224 bytes} [Mon Aug 29 20:25:05 2022] DELETE /identity/v3/users/a0c12c96e37c4fdf86d136ac3c967cf8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:05.256804 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.257112 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.257406 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.277902 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] MFA Rules not processed for user `8a682bb868194e74ab874d8a9a46c89e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 20:25:05.279624 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:05.345211 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1486/2941] 10.222.0.61 () {58 vars in 958 bytes} [Mon Aug 29 20:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 20:25:05.356363 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:05.358581 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:05.423982 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a34d8-07ba-485e-9ca3-0292cea96282 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:05.427954 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b25325b450fe4a14941600dd16c557fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:05.428570 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.428892 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.429139 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.439684 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:05.441179 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:05.451866 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1456/2942] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:25:05.800627 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:25:05.802845 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:25:05.819733 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024394b2-798b-4420-bae8-bc1ee9b6708b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:25:05.826519 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a682bb868194e74ab874d8a9a46c89e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f12e64257ff84ab8bb7ebdf7133980d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:25:05.827088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:25:05.827088 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:25:05.827452 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] PATH_INFO: `/v3/projects/17b93a2eb2e54df3ad40403b88f88228` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:25:05.828987 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b93a2eb2e54df3ad40403b88f88228)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:25:05.832130 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:25:05.894116 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b93a2eb2e54df3ad40403b88f88228', 'request_id': 'req-82fd060a-465d-4dd7-9504-7400229e77f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.901761 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b93a2eb2e54df3ad40403b88f88228', 'request_id': 'req-82fd060a-465d-4dd7-9504-7400229e77f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.914575 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b93a2eb2e54df3ad40403b88f88228', 'request_id': 'req-82fd060a-465d-4dd7-9504-7400229e77f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.932540 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] The token cache is being invalidate because project 17b93a2eb2e54df3ad40403b88f88228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 20:25:05.932828 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.933538 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82fd060a-465d-4dd7-9504-7400229e77f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 20:25:05.935135 dv-cinder-854261-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1487/2943] 10.222.0.61 () {58 vars in 1233 bytes} [Mon Aug 29 20:25:05 2022] DELETE /identity/v3/projects/17b93a2eb2e54df3ad40403b88f88228 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 20:25:15.447007 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:25:15.928981 dv-cinder-854261-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 20:28:14.022159 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 20:28:14.024062 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:14.099395 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6d362-db82-4348-ad4a-e3aa5ef003e2 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 20:28:14.163540 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e661de36a7dc4a4b9e265fe10da1fad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba72fb3f45b46698dfaca936fb2c5ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 20:28:14.164146 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 20:28:14.164421 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 20:28:14.164680 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 20:28:14.166772 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 20:28:14.179187 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 20:28:14.180835 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c75da7-d93f-4255-ad80-0f557caf04bf service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 20:28:14.192514 dv-cinder-854261-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1457/2944] 10.222.0.61 () {60 vars in 1365 bytes} [Mon Aug 29 20:28:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 20:28:24.187587 dv-cinder-854261-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=58 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}